00000001:02000400:2.0F:1788812928.776004:0:2957:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1788812942.138992:0:3177:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1788812943.431364:0:3225:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 719 MB/s 00000001:01000000:3.0:1788812943.681103:0:3225:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 843 MB/s 00000001:01000000:1.0F:1788812943.930880:0:3225:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5343 MB/s 00000020:02000000:2.0:1788812944.477467:0:3268:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_41_g50dbf09 00000400:02000000:2.0:1788812945.373931:0:3283:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.113@tcp [8/256/0/180] 00008000:02000000:1.0:1788812948.533345:0:3433:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788812982.978554:0:5237:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788812990.501975:0:5814:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788812990.501980:0:5814:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788812990.502105:0:5814:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000002b75143d 00000080:02000400:1.0:1788812990.502115:0:5814:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788812990.506640:0:5814:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788812990.506653:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788812990.506688:0:5814:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000003952240f) 00000020:00000080:1.0:1788812990.506718:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788812990.520660:0:5814:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788812990.521133:0:5814:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0F:1788812990.542110:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788812990.542223:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788812990.542246:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788812990.542296:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788812990.542321:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788812990.542649:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788812990.542657:0:5814:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788812990.542667:0:5814:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b294f297b1ebec8 00000020:01000004:0.0:1788812990.542674:0:5814:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1788812990.542679:0:5814:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788812990.542683:0:5814:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002b75143d from MGS 00000020:01000004:0.0:1788812990.542687:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788812990.542715:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000045c80eac) 00000020:00000080:0.0:1788812990.542728:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788812990.542857:0:5814:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002b75143d from MGS, refs=2 00080000:01000000:0.0:1788812990.542862:0:5814:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788812990.542867:0:5814:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b294f297b1ebed6 00000100:00100000:0.0:1788812990.542962:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788812990.544049:0:5814:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788812990.544056:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788812990.544509:0:5814:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788812990.544515:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788812990.545439:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788812990.545591:0:5814:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788812990.545597:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788812990.546257:0:5814:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788812990.546263:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788812990.546549:0:5814:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788812990.546555:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788812990.547269:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788812990.547273:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788812990.547274:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788812990.547594:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788812990.547596:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788812990.547597:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788812990.548230:0:5814:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788812990.552740:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788812990.800271:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3797 MB/s 00000001:01000000:0.0:1788812991.049931:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3795 MB/s 00000001:01000000:2.0:1788812991.300768:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 783 MB/s 00000001:01000000:2.0:1788812991.550976:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1271 MB/s 00080000:10000000:2.0:1788812991.567950:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:2.0:1788812991.581101:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788812991.581385:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788812991.581396:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788812991.581398:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788812991.583181:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788812991.583238:0:5814:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788812991.583283:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788812991.583575:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788812991.583603:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788812991.584230:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788812991.584429:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788812991.584436:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788812991.589990:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788812991.590003:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788812991.592041:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788812991.592052:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1788812991.593668:0:5830:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1788812991.593668:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788812991.593690:0:5814:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.113@tcp' 00000020:01000004:1.0:1788812991.593692:0:5814:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788812991.593804:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.113@tcp (typ=mgc) 00000020:00000080:1.0:1788812991.593815:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.113@tcp (00000000214f4cd9) 00000020:00000080:1.0:1788812991.593828:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788812991.593906:0:5814:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000fa68281d@MGC192.168.203.113@tcp: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1788812991.594070:0:5814:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.113@tcp-0 is initialized 00000040:01000000:1.0:1788812991.594081:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788812991.595928:0:5831:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788812991.596040:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.113@tcp (uuid f07e87b1-ea56-4ba9-97bf-449134c6ff58) 00000020:00000080:1.0:1788812991.596063:0:5814:0:(genops.c:1384:class_connect()) connect: client f07e87b1-ea56-4ba9-97bf-449134c6ff58, cookie 0x1b294f297b1ebee4 00000100:00080000:1.0:1788812991.596075:0:5814:0:(import.c:545:import_select_connection()) MGC192.168.203.113@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788812991.596084:0:5814:0:(import.c:666:import_select_connection()) MGC192.168.203.113@tcp: import 00000000fa68281d using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1788812991.596128:0:5814:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000e1420ea x1875706322616448/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788812991.596155:0:5814:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f07e87b1-ea56-4ba9-97bf-449134c6ff58->MGS 00000020:01000004:1.0:1788812991.596172:0:5814:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788812991.596177:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788812991.596190:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000081f7b64a) 00000020:00000080:1.0:1788812991.596203:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788812991.596253:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e1420ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3298:1875706322616448:0@lo:250: 00000100:00100000:0.0:1788812991.596328:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812991.601011:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322616448 00000100:00100000:0.0:1788812991.601025:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322616448 00000100:00100000:0.0:1788812991.601131:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788812991.601140:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000efc357c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3298:x1875706322616448:12345-0@lo:250: 00010000:00080000:0.0:1788812991.601177:0:5827:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from f07e87b1-ea56-4ba9-97bf-449134c6ff58@0@lo t0 exp 0000000000000000 cur 151 last 0 00000020:00000080:0.0:1788812991.601208:0:5827:0:(genops.c:1384:class_connect()) connect: client f07e87b1-ea56-4ba9-97bf-449134c6ff58, cookie 0x1b294f297b1ebef2 00000100:00080000:0.0:1788812991.601334:0:5827:0:(import.c:65:import_set_state_nolock()) 000000004cff2dde : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788812991.601418:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000efc357c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+5:3298:x1875706322616448:12345-0@lo:250: Request processed in 278us (5092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812991.601664:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788812991.601726:0:3298:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.113@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788812991.601735:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.113@tcp: connect to target with instance 0 00000100:00080000:0.0:1788812991.601743:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.113@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788812991.601747:0:3298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788812991.601750:0:3298:0:(import.c:65:import_set_state_nolock()) 00000000fa68281d MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788812991.601753:0:3298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788812991.601770:0:3298:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788812991.601775:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e1420ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3298:1875706322616448:0@lo:250: 00000100:00100000:1.0:1788812991.604444:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788812991.604837:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788812991.604844:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788812991.605858:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788812991.605868:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788812991.606147:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788812991.606155:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788812991.610521:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788812991.610831:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788812991.610838:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788812991.614481:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788812991.614493:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788812991.650817:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788812991.651012:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788812991.651019:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788812991.652727:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788812991.652739:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788812991.653456:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788812991.653621:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788812991.653625:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788812991.658146:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788812991.658157:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788812991.660293:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788812991.660457:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788812991.660462:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788812991.661223:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788812991.661228:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788812991.661713:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788812991.661907:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788812991.661912:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788812991.663043:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788812991.663053:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788812991.689141:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788812991.689375:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788812991.689546:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788812991.690541:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788812991.690551:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788812991.692571:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788812991.692583:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788812991.693584:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788812991.693604:0:5814:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788812991.693609:0:5814:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788812991.693764:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788812991.695958:0:5814:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.113@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788812991.695966:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788812991.695967:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788812991.695968:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788812991.695969:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788812991.695971:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788812991.695972:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788812991.695973:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788812991.695975:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788812991.695976:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788812991.695977:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788812991.695979:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788812991.695980:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788812991.695983:0:5814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788812991.695992:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788812991.695993:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788812991.695994:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788812991.695995:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788812991.695995:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788812991.695996:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788812991.695997:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788812991.695998:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788812991.695999:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788812991.696000:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788812991.696000:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788812991.696001:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788812991.696038:0:5814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788812991.696054:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007033ff39 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322616576:0@lo:253: 00000100:00100000:2.0:1788812991.696139:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812991.696192:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 0000000073cda604 going to sleep for 11 seconds 00000100:00100000:0.0:1788812991.696257:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322616576 00000100:00100000:0.0:1788812991.696265:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322616576 00000100:00100000:0.0:1788812991.696305:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788812991.696313:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f7d0233d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+5:5814:x1875706322616576:12345-0@lo:253: 20000000:01000000:0.0:1788812991.696350:0:5829:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788812991.696352:0:5829:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788812991.696776:0:5850:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788812991.696936:0:5829:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788812991.697208:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788812991.698273:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788812991.698495:0:5829:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788812991.698499:0:5829:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788812991.698505:0:5829:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788812991.698508:0:5829:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788812991.698523:0:5829:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788812991.698731:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788812991.699037:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788812991.699050:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788812991.699107:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788812991.699163:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788812991.699203:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788812991.699294:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788812991.699303:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788812991.699350:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788812991.699359:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788812991.699392:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788812991.699401:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788812991.699432:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788812991.699487:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788812991.699516:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788812991.699520:0:5829:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788812991.699536:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788812991.699756:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788812991.699767:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788812991.699832:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788812991.699872:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788812991.699923:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788812991.699934:0:5829:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788812991.700016:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788812991.700025:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788812991.700070:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788812991.700111:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788812991.700150:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788812991.700161:0:5829:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788812991.700244:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788812991.700254:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788812991.700287:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788812991.700321:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788812991.700455:0:5829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788812991.700496:0:5829:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788812991.700507:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788812991.701427:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788812991.702978:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788812991.703006:0:5829:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.113@tcp for mdt 20000000:01000000:0.0:1788812991.703015:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:0.0:1788812991.703056:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788812991.703064:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788812991.703115:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788812991.703124:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:0.0:1788812991.703174:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788812991.703186:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788812991.703219:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788812991.703257:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788812991.703326:0:5829:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788812991.703329:0:5829:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788812991.703333:0:5829:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788812991.703345:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788812991.703348:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788812991.703378:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788812991.703380:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788812991.706945:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1788812991.707252:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788812991.707300:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1788812991.707370:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1788812991.707383:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788812991.707386:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788812991.708134:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788812991.708363:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788812991.708405:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788812991.708441:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1788812991.708453:0:5829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788812991.708455:0:5829:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788812991.708459:0:5829:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788812991.708462:0:5829:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788812991.708466:0:5829:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788812991.708472:0:5829:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788812991.714036:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1788812991.717339:0:5829:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788812991.729289:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1788812991.729347:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1788812991.729444:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1788812991.729467:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788812991.729488:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ed92fd09/0x1b294f297b1ebef9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812991.729504:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ed92fd09/0x1b294f297b1ebef9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812991.729515:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ed92fd09/0x1b294f297b1ebef9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812991.729522:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ed92fd09/0x1b294f297b1ebef9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812991.729528:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ed92fd09/0x1b294f297b1ebef9 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812991.729534:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ed92fd09/0x1b294f297b1ebef9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812991.729540:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ed92fd09 already unused, calling callback (00000000c2ea6dc3) 00010000:00010000:0.0:1788812991.729544:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ed92fd09/0x1b294f297b1ebef9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812991.729551:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ed92fd09/0x1b294f297b1ebef9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812991.729563:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ed92fd09/0x1b294f297b1ebef9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812991.729570:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ed92fd09/0x1b294f297b1ebef9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812991.729586:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ed92fd09/0x1b294f297b1ebef9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788812991.729604:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788812991.949138:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f7d0233d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+5:5814:x1875706322616576:12345-0@lo:253: Request processed in 252820us (252993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812991.949153:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788812991.949256:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007033ff39 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322616576:0@lo:253: 10000000:01000000:2.0:1788812991.949272:0:5814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788812991.949275:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788812991.949277:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788812991.949279:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788812991.949280:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788812991.949281:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788812991.949282:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788812991.949284:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788812991.949285:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788812991.949287:0:5814:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788812991.949288:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788812991.949290:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788812991.949307:0:5814:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002b75143d from lustre-MDT0000 10000000:01000000:2.0:1788812991.949334:0:5814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788812991.949336:0:5814:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788812991.949340:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93ef2a35b380 10000000:01000000:2.0:1788812991.949344:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788812991.949351:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93ef2a35b380 from 1 10000000:01000000:2.0:1788812991.949365:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788812991.949401:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000a91252f2/0x1b294f297b1ebf00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812991.949409:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000a91252f2/0x1b294f297b1ebf00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812991.949417:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000a91252f2/0x1b294f297b1ebf00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788812991.949433:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007033ff39 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322616704:0@lo:101: 00000100:00100000:2.0:1788812991.949469:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812991.949531:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f75df8aa going to sleep for 11 seconds 00000100:00100000:0.0:1788812991.949594:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322616704 00000100:00100000:0.0:1788812991.949601:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322616704 00000100:00100000:0.0:1788812991.949636:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788812991.949644:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007677b253 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+5:5814:x1875706322616704:12345-0@lo:101: 00010000:00010000:0.0:1788812991.949655:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788812991.949666:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ed92fd09/0x1b294f297b1ebf07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ebf00 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812991.949686:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ed92fd09/0x1b294f297b1ebf07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ebf00 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812991.949706:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ed92fd09/0x1b294f297b1ebf07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ebf00 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812991.949713:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ed92fd09, rc 0) 00000100:00100000:0.0:1788812991.949851:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007677b253 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+6:5814:x1875706322616704:12345-0@lo:101: Request processed in 208us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812991.949867:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788812991.950110:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007033ff39 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322616704:0@lo:101: 00010000:00010000:2.0:1788812991.950123:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000a91252f2/0x1b294f297b1ebf00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ebf07 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812991.950131:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000a91252f2/0x1b294f297b1ebf00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ebf07 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788812991.950175:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007033ff39 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322616832:0@lo:501: 00000100:00100000:2.0:1788812991.950201:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812991.950265:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f75df8aa going to sleep for 11 seconds 00000100:00100000:0.0:1788812991.950301:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322616832 00000100:00100000:0.0:1788812991.950305:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322616832 00000100:00100000:0.0:1788812991.950367:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788812991.950388:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e7a51cfa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+6:5814:x1875706322616832:12345-0@lo:501: 00000100:00100000:0.0:1788812991.950702:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e7a51cfa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+6:5814:x1875706322616832:12345-0@lo:501: Request processed in 305us (490us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788812991.950710:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788812991.950809:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007033ff39 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322616832:0@lo:501: 10000000:01000000:2.0:1788812991.950833:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788812991.950851:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000a91252f2/0x1b294f297b1ebf00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ebf07 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812991.950860:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000a91252f2/0x1b294f297b1ebf00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ebf07 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788812991.950876:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93ef2171d800 10000000:01000000:2.0:1788812991.950880:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788812991.950884:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93ef2171d800 10000000:01000000:2.0:1788812991.950886:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788812991.950889:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93ef2171d800 from 1 10000000:01000000:2.0:1788812991.950891:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788812991.950908:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000f721b50b/0x1b294f297b1ebf0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812991.950915:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000f721b50b/0x1b294f297b1ebf0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812991.950923:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000f721b50b/0x1b294f297b1ebf0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788812991.950935:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007033ff39 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322616960:0@lo:101: 00000100:00100000:2.0:1788812991.950960:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812991.950977:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f75df8aa going to sleep for 11 seconds 00000100:00100000:1.0:1788812991.951043:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322616960 00000100:00100000:1.0:1788812991.951047:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322616960 00000100:00100000:1.0:1788812991.951082:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788812991.951088:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000bc2843d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+6:5814:x1875706322616960:12345-0@lo:101: 00010000:00010000:1.0:1788812991.951096:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788812991.951107:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000501f7a05/0x1b294f297b1ebf15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ebf0e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812991.951121:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000501f7a05/0x1b294f297b1ebf15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ebf0e expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812991.951128:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000501f7a05/0x1b294f297b1ebf15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ebf0e expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812991.951135:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000501f7a05, rc 0) 00000100:00100000:1.0:1788812991.951180:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000bc2843d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+7:5814:x1875706322616960:12345-0@lo:101: Request processed in 92us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812991.951185:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788812991.951299:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007033ff39 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322616960:0@lo:101: 00010000:00010000:2.0:1788812991.951410:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000f721b50b/0x1b294f297b1ebf0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ebf15 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812991.951419:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000f721b50b/0x1b294f297b1ebf0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ebf15 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788812991.951429:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788812991.951441:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000f721b50b/0x1b294f297b1ebf0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ebf15 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812991.951457:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000f721b50b/0x1b294f297b1ebf0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ebf15 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788812991.951464:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788812991.951467:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788812991.951470:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93ef2171d800 10000000:01000000:2.0:1788812991.951472:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788812991.951475:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788812991.951477:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788812991.951491:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 000000008c8c322f/0x1b294f297b1ebf1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812991.951497:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 000000008c8c322f/0x1b294f297b1ebf1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812991.951502:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 000000008c8c322f/0x1b294f297b1ebf1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788812991.951513:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007033ff39 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322617088:0@lo:101: 00000100:00100000:2.0:1788812991.951536:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812991.951595:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f75df8aa going to sleep for 11 seconds 00000100:00100000:0.0:1788812991.951691:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322617088 00000100:00100000:0.0:1788812991.951706:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322617088 00000100:00100000:0.0:1788812991.951738:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788812991.951744:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001f3d070e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+7:5814:x1875706322617088:12345-0@lo:101: 00010000:00010000:0.0:1788812991.951751:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788812991.951759:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000099f39287/0x1b294f297b1ebf23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ebf1c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812991.951772:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000099f39287/0x1b294f297b1ebf23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ebf1c expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812991.951874:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000099f39287/0x1b294f297b1ebf23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ebf1c expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812991.951882:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000099f39287, rc 0) 00000100:00100000:0.0:1788812991.951955:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001f3d070e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+8:5814:x1875706322617088:12345-0@lo:101: Request processed in 212us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812991.951962:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788812991.952045:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007033ff39 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322617088:0@lo:101: 00010000:00010000:2.0:1788812991.952055:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 000000008c8c322f/0x1b294f297b1ebf1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ebf23 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812991.952062:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 000000008c8c322f/0x1b294f297b1ebf1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ebf23 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788812991.952115:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007033ff39 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322617216:0@lo:501: 00000100:00100000:2.0:1788812991.952139:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812991.952202:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f75df8aa going to sleep for 11 seconds 00000100:00100000:3.0:1788812991.952244:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322617216 00000100:00100000:3.0:1788812991.952249:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322617216 00000100:00100000:3.0:1788812991.952326:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788812991.952333:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008c73904d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+8:5814:x1875706322617216:12345-0@lo:501: 00000100:00100000:3.0:1788812991.952636:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008c73904d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+9:5814:x1875706322617216:12345-0@lo:501: Request processed in 304us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812991.952643:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788812991.953078:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007033ff39 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322617216:0@lo:501: 00000100:00100000:2.0:1788812991.953109:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007033ff39 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322617344:0@lo:503: 00000100:00100000:2.0:1788812991.953147:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812991.953213:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f75df8aa going to sleep for 11 seconds 00000100:00100000:3.0:1788812991.953265:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322617344 00000100:00100000:3.0:1788812991.953269:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322617344 00000100:00100000:3.0:1788812991.953299:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788812991.953304:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000025d87c42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+9:5814:x1875706322617344:12345-0@lo:503: 00000100:00100000:3.0:1788812991.953445:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000025d87c42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+9:5814:x1875706322617344:12345-0@lo:503: Request processed in 141us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812991.953452:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788812991.953560:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007033ff39 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322617344:0@lo:503: 00000100:00100000:2.0:1788812991.953957:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007033ff39 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5857:1875706322617472:0@lo:502: 00000100:00100000:2.0:1788812991.953989:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812991.954047:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017c2d6fa going to sleep for 11 seconds 00000100:00100000:3.0:1788812991.954082:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322617472 00000100:00100000:3.0:1788812991.954086:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322617472 00000100:00100000:3.0:1788812991.954141:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788812991.954147:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e48b8110 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+9:5857:x1875706322617472:12345-0@lo:502: 00000100:00100000:3.0:1788812991.954279:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e48b8110 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+9:5857:x1875706322617472:12345-0@lo:502: Request processed in 132us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812991.954285:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788812991.954346:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007033ff39 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5857:1875706322617472:0@lo:502: 00000020:01000000:2.0:1788812991.954366:0:5857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788812991.954376:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788812991.954378:0:5857:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788812991.954383:0:5857:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788812991.954386:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788812991.954404:0:5857:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000116e0282) 00000020:00000080:2.0:1788812991.954425:0:5857:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788812991.954431:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788812991.954495:0:5857:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788812991.954502:0:5857:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b294f297b1ebf31 00000020:00000080:2.0:1788812991.954691:0:5857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788812991.954708:0:5857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788812991.954711:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788812991.954717:0:5857:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788812991.954720:0:5857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788812991.954724:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788812991.954725:0:5857:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788812991.954728:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788812991.954734:0:5857:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000bfaa6c35) 00000020:00000080:2.0:1788812991.954743:0:5857:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788812991.954747:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788812991.954748:0:5857:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788812991.954751:0:5857:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788812991.954757:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788812991.954824:0:5857:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002b75143d from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788812991.954836:0:5857:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000009af7437e) 00000020:00000080:2.0:1788812991.954844:0:5857:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788812991.954886:0:5857:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788812991.954901:0:5857:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b294f297b1ebf46 00000020:00000080:2.0:1788812991.954983:0:5857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788812991.954988:0:5857:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788812991.954993:0:5857:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1b294f297b1ebf4d 00080000:01000000:2.0:1788812991.954997:0:5857:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788812991.955001:0:5857:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b294f297b1ebf54 00080000:10000000:2.0:1788812991.955325:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1788812991.955504:0:5857:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788812991.959901:0:5857:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1788812992.072890:0:5857:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1788812992.073217:0:5857:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1788812992.080978:0:5857:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788812992.086662:0:5857:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788812992.148480:0:5857:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000066380dac) 00000020:00000080:0.0:1788812992.148501:0:5857:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788812992.148563:0:5857:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788812992.148569:0:5857:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b294f297b1ebf62 00000020:00000080:3.0:1788812992.150962:0:5857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788812992.160648:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788812992.249851:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788812992.319447:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788812992.364684:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788812992.390760:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788812992.416635:0:5857:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1788812992.461215:0:5857:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1b294f297b1ebf69 00000020:00000080:2.0:1788812992.461561:0:5857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788812992.461572:0:5857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788812992.461577:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788812992.461580:0:5857:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788812992.461588:0:5857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788812992.461593:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788812992.461594:0:5857:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788812992.461597:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788812992.461598:0:5857:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788812992.461601:0:5857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788812992.461603:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788812992.461604:0:5857:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788812992.461606:0:5857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788812992.461610:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788812992.461611:0:5857:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788812992.461614:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788812992.461645:0:5857:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788812992.461700:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007033ff39 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5857:1875706322617600:0@lo:502: 00000100:00100000:2.0:1788812992.461776:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812992.461843:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b0e9872e going to sleep for 11 seconds 00000100:00100000:2.0:1788812992.461868:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322617600 00000100:00100000:2.0:1788812992.461873:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322617600 00000100:00100000:2.0:1788812992.461907:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788812992.461915:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f6e24ade pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+9:5857:x1875706322617600:12345-0@lo:502: 00000100:00100000:2.0:1788812992.462265:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f6e24ade pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+9:5857:x1875706322617600:12345-0@lo:502: Request processed in 351us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788812992.462274:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788812992.462321:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007033ff39 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5857:1875706322617600:0@lo:502: 00000020:01000000:2.0:1788812992.462345:0:5857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788812992.462349:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788812992.462350:0:5857:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788812992.462353:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788812992.462847:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788812992.462868:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788812992.462883:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 000000008c8c322f/0x1b294f297b1ebf1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ebf23 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.462895:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 000000008c8c322f/0x1b294f297b1ebf1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ebf23 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788812992.462903:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93ef2171d800 from 1 10000000:01000000:0.0:1788812992.462906:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788812992.462945:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000edaf465e/0x1b294f297b1ebf70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.462952:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000edaf465e/0x1b294f297b1ebf70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.462961:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000edaf465e/0x1b294f297b1ebf70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812992.462976:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098d48096 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322617728:0@lo:101: 00000100:00100000:0.0:1788812992.463013:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812992.463038:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000897cb7cb going to sleep for 11 seconds 00000100:00100000:2.0:1788812992.463843:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322617728 00000100:00100000:2.0:1788812992.463853:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322617728 00000100:00100000:2.0:1788812992.463908:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788812992.463915:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000049e78655 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+9:5814:x1875706322617728:12345-0@lo:101: 00010000:00010000:2.0:1788812992.463928:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788812992.463943:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000068e2a1ab/0x1b294f297b1ebf77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ebf70 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812992.463964:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000068e2a1ab/0x1b294f297b1ebf77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ebf70 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812992.463975:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000068e2a1ab/0x1b294f297b1ebf77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ebf70 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812992.463982:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000068e2a1ab, rc 0) 00000100:00100000:2.0:1788812992.464025:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000049e78655 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+10:5814:x1875706322617728:12345-0@lo:101: Request processed in 111us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788812992.464031:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788812992.464120:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098d48096 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322617728:0@lo:101: 00010000:00010000:0.0:1788812992.464133:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000edaf465e/0x1b294f297b1ebf70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ebf77 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.464154:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000edaf465e/0x1b294f297b1ebf70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ebf77 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812992.464719:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098d48096 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322617856:0@lo:256: 00000100:00100000:0.0:1788812992.464770:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812992.464840:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000897cb7cb going to sleep for 11 seconds 00000100:00100000:0.0:1788812992.464860:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322617856 00000100:00100000:0.0:1788812992.464865:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322617856 00000100:00100000:0.0:1788812992.464896:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788812992.464903:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000031a558b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+10:5814:x1875706322617856:12345-0@lo:256: 20000000:01000000:0.0:1788812992.464917:0:5827:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788812992.464922:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788812992.464983:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000031a558b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+10:5814:x1875706322617856:12345-0@lo:256: Request processed in 81us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812992.464989:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788812992.465021:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098d48096 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322617856:0@lo:256: 10000000:01000000:0.0:1788812992.465580:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788812992.465595:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000edaf465e/0x1b294f297b1ebf70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ebf77 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.465604:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000edaf465e/0x1b294f297b1ebf70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ebf77 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788812992.465611:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ef2171d800 from 1 10000000:01000000:0.0:1788812992.465613:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788812992.465637:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000d75aa86f/0x1b294f297b1ebf7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.465644:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000d75aa86f/0x1b294f297b1ebf7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.465650:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000d75aa86f/0x1b294f297b1ebf7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812992.465674:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098d48096 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322617984:0@lo:101: 00000100:00100000:0.0:1788812992.465718:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812992.465733:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000897cb7cb going to sleep for 11 seconds 00000100:00100000:0.0:1788812992.465755:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322617984 00000100:00100000:0.0:1788812992.465760:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322617984 00000100:00100000:0.0:1788812992.465805:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788812992.465811:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000000e0de25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+10:5814:x1875706322617984:12345-0@lo:101: 00010000:00010000:0.0:1788812992.465821:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788812992.465831:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ed593c99/0x1b294f297b1ebf85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ebf7e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.465846:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ed593c99/0x1b294f297b1ebf85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ebf7e expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.465854:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ed593c99/0x1b294f297b1ebf85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ebf7e expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.465861:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ed593c99, rc 0) 00000100:00100000:0.0:1788812992.465887:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000000e0de25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:5814:x1875706322617984:12345-0@lo:101: Request processed in 76us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812992.465892:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788812992.465923:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098d48096 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322617984:0@lo:101: 00010000:00010000:0.0:1788812992.465933:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000d75aa86f/0x1b294f297b1ebf7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ebf85 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.465940:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000d75aa86f/0x1b294f297b1ebf7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ebf85 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812992.465990:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098d48096 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322618112:0@lo:501: 00000100:00100000:0.0:1788812992.466012:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812992.466025:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000897cb7cb going to sleep for 11 seconds 00000100:00100000:0.0:1788812992.466038:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322618112 00000100:00100000:0.0:1788812992.466041:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322618112 00000100:00100000:0.0:1788812992.466057:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788812992.466061:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c1ad694c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:5814:x1875706322618112:12345-0@lo:501: 00000100:00100000:0.0:1788812992.466592:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c1ad694c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:5814:x1875706322618112:12345-0@lo:501: Request processed in 529us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812992.466599:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788812992.466659:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098d48096 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322618112:0@lo:501: 00000100:00100000:0.0:1788812992.466684:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098d48096 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322618240:0@lo:503: 00000100:00100000:0.0:1788812992.466735:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812992.466749:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000897cb7cb going to sleep for 11 seconds 00000100:00100000:0.0:1788812992.466763:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322618240 00000100:00100000:0.0:1788812992.466767:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322618240 00000100:00100000:0.0:1788812992.466805:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788812992.466811:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000071bd236d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:5814:x1875706322618240:12345-0@lo:503: 00000040:00080000:0.0:1788812992.466841:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788812992.466877:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000071bd236d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:5814:x1875706322618240:12345-0@lo:503: Request processed in 66us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812992.466883:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788812992.466917:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098d48096 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322618240:0@lo:503: 00000040:00080000:0.0:1788812992.467579:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788812992.467626:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788812992.467647:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788812992.467657:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000d75aa86f/0x1b294f297b1ebf7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ebf85 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.467667:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000d75aa86f/0x1b294f297b1ebf7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ebf85 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788812992.468357:0:5814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788812992.468362:0:5814:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93ef2171d800 10000000:01000000:0.0:1788812992.468365:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93ef2171d800 10000000:01000000:0.0:1788812992.468369:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788812992.468374:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93ef2171d800 from 1 10000000:01000000:0.0:1788812992.468377:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788812992.468402:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 0000000045556717/0x1b294f297b1ebf8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.468412:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 0000000045556717/0x1b294f297b1ebf8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.468421:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 0000000045556717/0x1b294f297b1ebf8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812992.468438:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098d48096 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322618368:0@lo:101: 00000100:00100000:0.0:1788812992.468482:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812992.468524:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 0000000012a0a5f2 going to sleep for 11 seconds 00000100:00100000:1.0:1788812992.468578:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322618368 00000100:00100000:1.0:1788812992.468585:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322618368 00000100:00100000:1.0:1788812992.468623:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788812992.468631:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005d25bbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:5814:x1875706322618368:12345-0@lo:101: 00010000:00010000:1.0:1788812992.468641:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788812992.468651:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000032c0eb3b/0x1b294f297b1ebf93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ebf8c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812992.468683:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000032c0eb3b/0x1b294f297b1ebf93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ebf8c expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812992.468702:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000032c0eb3b/0x1b294f297b1ebf93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ebf8c expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812992.468709:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000032c0eb3b, rc 0) 00000100:00100000:1.0:1788812992.468814:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005d25bbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:5814:x1875706322618368:12345-0@lo:101: Request processed in 184us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812992.468819:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788812992.468975:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098d48096 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322618368:0@lo:101: 00010000:00010000:2.0:1788812992.468987:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 0000000045556717/0x1b294f297b1ebf8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ebf93 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788812992.468995:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 0000000045556717/0x1b294f297b1ebf8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ebf93 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788812992.469037:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007033ff39 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322618496:0@lo:501: 00000100:00100000:2.0:1788812992.469059:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812992.469112:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eb72b983 going to sleep for 11 seconds 00000100:00100000:0.0:1788812992.469206:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322618496 00000100:00100000:0.0:1788812992.469211:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322618496 00000100:00100000:0.0:1788812992.469263:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788812992.469270:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000012cc20d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:5814:x1875706322618496:12345-0@lo:501: 00000100:00100000:0.0:1788812992.469482:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000012cc20d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:5814:x1875706322618496:12345-0@lo:501: Request processed in 212us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812992.469494:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788812992.469549:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007033ff39 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322618496:0@lo:501: 00000100:00100000:2.0:1788812992.469574:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007033ff39 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322618624:0@lo:503: 00000100:00100000:2.0:1788812992.469615:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812992.469679:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eb72b983 going to sleep for 11 seconds 00000100:00100000:1.0:1788812992.469754:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322618624 00000100:00100000:1.0:1788812992.469759:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322618624 00000100:00100000:1.0:1788812992.469776:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788812992.469808:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000085806e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:5814:x1875706322618624:12345-0@lo:503: 00000100:00100000:1.0:1788812992.470083:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000085806e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:5814:x1875706322618624:12345-0@lo:503: Request processed in 302us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812992.470090:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788812992.470181:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007033ff39 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322618624:0@lo:503: 00000100:00100000:2.0:1788812992.470529:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007033ff39 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5862:1875706322618752:0@lo:502: 00000100:00100000:2.0:1788812992.470568:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788812992.470597:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fd887fb6 going to sleep for 11 seconds 00000100:00100000:1.0:1788812992.470634:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322618752 00000100:00100000:1.0:1788812992.470639:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322618752 00000100:00100000:1.0:1788812992.470658:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788812992.470664:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c8e4dcce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:5862:x1875706322618752:12345-0@lo:502: 00000100:00100000:1.0:1788812992.470886:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c8e4dcce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:5862:x1875706322618752:12345-0@lo:502: Request processed in 223us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812992.470893:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788812992.470969:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007033ff39 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5862:1875706322618752:0@lo:502: 00000020:01000004:2.0:1788812992.471018:0:5862:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788812992.471030:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000000989455f) 00000020:00000080:2.0:1788812992.471047:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788812992.471125:0:5862:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002b75143d from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788812992.471129:0:5862:0:(tgt_mount.c:187:server_put_mount()) put mount 000000002b75143d from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788812992.471131:0:5862:0:(obd_mount.c:710:lustre_put_lsi()) put 000000002b75143d 4 00010000:00080000:2.0:1788812992.471166:0:5862:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008281f2dd@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1788812992.472767:0:5862:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1788812992.473017:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788812992.473049:0:5862:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788812992.473060:0:5862:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1b294f297b1ebfa1 00000100:00080000:2.0:1788812992.473069:0:5862:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788812992.473077:0:5862:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008281f2dd using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788812992.473106:0:5862:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007033ff39 x1875706322618880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788812992.473134:0:5862:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788812992.475201:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007033ff39 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875706322618880:0@lo:38: 00000100:00100000:0.0:1788812992.475270:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812992.475439:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb5b894b pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5862:1875706322619008:0@lo:502: 00000100:00100000:0.0:1788812992.475479:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812992.475501:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322619008 00000100:00100000:0.0:1788812992.475506:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322619008 00000100:00100000:0.0:1788812992.475537:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788812992.475545:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009d40bd92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:5862:x1875706322619008:12345-0@lo:502: 00000100:00100000:0.0:1788812992.475754:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009d40bd92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:5862:x1875706322619008:12345-0@lo:502: Request processed in 209us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812992.475762:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788812992.475877:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set 000000006efd1e14 going to sleep for 11 seconds 00000100:00100000:0.0:1788812992.475896:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb5b894b pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5862:1875706322619008:0@lo:502: 00000040:00080000:0.0:1788812992.475918:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:1.0:1788812992.476088:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322618880 00000100:00100000:1.0:1788812992.476094:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322618880 00000100:00100000:1.0:1788812992.476122:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788812992.476140:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a610651d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1875706322618880:12345-0@lo:38: 00000100:00100000:1.0:1788812992.476180:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a610651d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1875706322618880:12345-0@lo:38: Request processed in 40us (911us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788812992.476185:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:1.0:1788812992.476204:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788812992.476219:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788812992.476228:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 0000000045556717/0x1b294f297b1ebf8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ebf93 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812992.476238:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 0000000045556717/0x1b294f297b1ebf8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ebf93 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788812992.476276:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788812992.476278:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788812992.476279:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788812992.476280:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788812992.476281:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788812992.476283:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788812992.476284:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788812992.476285:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788812992.476286:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788812992.476287:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788812992.476288:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788812992.476290:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788812992.476292:0:5814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788812992.476295:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788812992.476296:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788812992.476297:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788812992.476298:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788812992.476299:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788812992.476299:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788812992.476300:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788812992.476301:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788812992.476302:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788812992.476303:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788812992.476304:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788812992.476307:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788812992.476326:0:5814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788812992.476333:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d19ff654 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322619136:0@lo:253: 00000100:00100000:1.0:1788812992.476359:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812992.476370:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 0000000068edaa3a going to sleep for 11 seconds 00000100:00100000:0.0:1788812992.476461:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788812992.476467:0:3298:0:(import.c:65:import_set_state_nolock()) 000000008281f2dd lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788812992.476471:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788812992.476473:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007033ff39 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875706322618880:0@lo:38: 00000100:00100000:0.0:1788812992.476492:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322619136 00000100:00100000:0.0:1788812992.476495:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322619136 00000100:00100000:0.0:1788812992.476521:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788812992.476526:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cf306d1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:5814:x1875706322619136:12345-0@lo:253: 20000000:01000000:0.0:1788812992.476543:0:5827:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788812992.476554:0:5827:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788812992.507558:0:5827:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788812992.507572:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788812992.507590:0:5850:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788812992.507594:0:5850:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788812992.507612:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000061392382/0x1b294f297b1ebfa8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.507630:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000068e2a1ab/0x1b294f297b1ebf77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ebf70 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.507637:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000061392382/0x1b294f297b1ebfa8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.507674:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000068e2a1ab/0x1b294f297b1ebf77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ebf70 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.507688:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000068e2a1ab/0x1b294f297b1ebf77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ebf70 expref: 12 pid: 5828 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788812992.507712:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb5b894b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5850:1875706322619264:0@lo:104: 00000100:00100000:0.0:1788812992.507775:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812992.507841:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d68f5a76 going to sleep for 11 seconds 00000100:00100000:0.0:1788812992.507867:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322619264 00000100:00100000:0.0:1788812992.507874:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322619264 00000100:00100000:0.0:1788812992.507917:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788812992.507924:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a14d9dd2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:5850:x1875706322619264:12345-0@lo:104: 00010000:00010000:0.0:1788812992.507936:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 00000000edaf465e/0x1b294f297b1ebf70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ebf77 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.507983:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788812992.507988:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a14d9dd2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:5850:x1875706322619264:12345-0@lo:104: Request processed in 66us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788812992.508009:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788812992.508048:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb5b894b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5850:1875706322619264:0@lo:104: 00010000:00010000:0.0:1788812992.508063:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000061392382/0x1b294f297b1ebfa8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.508078:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788812992.508083:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 00000000edaf465e/0x1b294f297b1ebf70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ebf77 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.508089:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000edaf465e already unused, calling callback (00000000e33fba64) 10000000:00010000:0.0:1788812992.508093:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 00000000edaf465e/0x1b294f297b1ebf70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ebf77 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.508101:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 00000000edaf465e/0x1b294f297b1ebf70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ebf77 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788812992.508107:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 00000000edaf465e/0x1b294f297b1ebf70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ebf77 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788812992.508113:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788812992.508521:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 00000000edaf465e/0x1b294f297b1ebf70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ebf77 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.508530:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788812992.508658:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb5b894b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322619392:0@lo:103: 00000100:00100000:3.0:1788812992.508714:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788812992.508762:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 00000000edaf465e/0x1b294f297b1ebf70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ebf77 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.508770:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 00000000edaf465e/0x1b294f297b1ebf70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ebf77 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.508816:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788812992.508818:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788812992.508820:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788812992.511116:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322619392 00000100:00100000:1.0:1788812992.511131:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322619392 00010000:00010000:1.0:1788812992.511177:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000068e2a1ab/0x1b294f297b1ebf77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ebf70 expref: 13 pid: 5828 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788812992.511212:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788812992.511220:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e426f4f7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:3300:x1875706322619392:12345-0@lo:103: 00010000:00010000:1.0:1788812992.511233:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788812992.511237:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000068e2a1ab/0x1b294f297b1ebf77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ebf70 expref: 13 pid: 5828 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812992.511248:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000068e2a1ab/0x1b294f297b1ebf77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ebf70 expref: 13 pid: 5828 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812992.511264:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000068e2a1ab/0x1b294f297b1ebf77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ebf70 expref: 13 pid: 5828 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812992.511279:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000061392382/0x1b294f297b1ebfa8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812992.511286:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000061392382/0x1b294f297b1ebfa8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788812992.511303:0:5818:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003709807s 00010000:00010000:1.0:1788812992.511307:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000061392382/0x1b294f297b1ebfa8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812992.511329:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000061392382/0x1b294f297b1ebfa8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812992.511335:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000061392382/0x1b294f297b1ebfa8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812992.511341:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000061392382/0x1b294f297b1ebfa8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812992.511347:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000061392382 already unused, calling callback (00000000c2ea6dc3) 00010000:00010000:1.0:1788812992.511351:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000061392382/0x1b294f297b1ebfa8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812992.511358:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000061392382/0x1b294f297b1ebfa8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812992.511371:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000061392382/0x1b294f297b1ebfa8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788812992.511382:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788812992.511593:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e426f4f7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:3300:x1875706322619392:12345-0@lo:103: Request processed in 373us (2878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812992.511600:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788812992.511712:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb5b894b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322619392:0@lo:103: 00010000:00010000:0.0:1788812992.512515:0:5850:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000061392382/0x1b294f297b1ebfa8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.512527:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000061392382/0x1b294f297b1ebfa8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788812992.512533:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000061392382/0x1b294f297b1ebfa8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788812992.516311:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cf306d1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:5814:x1875706322619136:12345-0@lo:253: Request processed in 39778us (39944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812992.516325:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788812992.516413:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d19ff654 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5814:1875706322619136:0@lo:253: 10000000:01000000:0.0:1788812992.516427:0:5814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788812992.516430:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788812992.516432:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788812992.516434:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788812992.516435:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788812992.516436:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788812992.516437:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788812992.516438:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788812992.516439:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788812992.516440:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788812992.516441:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788812992.516442:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788812992.516444:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788812992.516457:0:5814:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788812992.523931:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788812992.524428:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788812992.524764:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788812992.525562:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788812992.525873:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788812992.526045:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788812992.526767:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788812992.527240:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788812992.527435:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788812992.527599:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788812992.527897:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788812992.528109:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1788812992.563844:0:5814:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788812992.589993:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788812992.590217:0:5867:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788812992.590221:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788812992.590407:0:5868:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788812992.599090:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788812992.600767:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788812992.601398:0:5814:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788812992.601418:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788812992.601572:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788812992.602563:0:5814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788812992.603143:0:5814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788812992.603172:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788812992.603394:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788812992.603604:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788812992.610554:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788812992.610699:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788812992.610846:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788812992.611285:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788812992.611414:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788812992.611554:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788812992.611669:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788812992.611854:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788812992.612017:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788812992.612158:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788812992.612301:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788812992.612446:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788812992.612591:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00010000:00010000:2.0:1788812992.612628:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788812992.613209:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788812992.613423:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788812992.613567:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788812992.614584:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788812992.614752:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788812992.614978:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788812992.615123:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788812992.615604:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788812992.615800:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788812992.617616:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788812992.617877:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788812992.618025:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788812992.618172:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788812992.619200:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788812992.619486:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788812992.619634:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788812992.619814:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788812992.620073:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788812992.620220:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788812992.620675:0:5814:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1788812992.634019:0:5868:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1788812992.677651:0:5814:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788812992.677686:0:5814:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa9e5c1c87988 00100000:10000000:0.0:1788812992.677702:0:5814:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788812992.678393:0:5814:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788812992.678408:0:5814:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788812992.678427:0:5814:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788812992.678442:0:5814:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1788812992.728249:0:5868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788812992.728321:0:5868:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788812992.728325:0:5868:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1788812993.629717:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788812994.657228:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788812995.676906:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788812996.083719:0:6110:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788812996.702655:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788812997.725328:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788812997.790169:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788812997.790181:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788812997.790185:0:37:0:(import.c:65:import_set_state_nolock()) 000000008281f2dd lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788812997.790208:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008281f2dd using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1788812997.790232:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003bef74d1 x1875706322619648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788812997.790525:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000477ab934 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322619520:0@lo:400: 00000100:00100000:0.0:1788812997.790613:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788812997.790698:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003bef74d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875706322619648:0@lo:38: 00000100:00100000:0.0:1788812997.790734:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788812997.790954:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322619648 00000100:00100000:1.0:1788812997.790964:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322619648 00000100:00100000:1.0:1788812997.791007:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788812997.791015:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000246b8925 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3298:x1875706322619648:12345-0@lo:38: 00010000:00080000:1.0:1788812997.791047:0:5836:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 158 last 0 00000020:00000080:1.0:1788812997.791098:0:5836:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1b294f297b1ebfaf 00000004:00100000:1.0:1788812997.791155:0:5836:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788812997.791317:0:5836:0:(import.c:65:import_set_state_nolock()) 00000000619b68fa : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788812997.791388:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000246b8925 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875706322619648:12345-0@lo:38: Request processed in 372us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788812997.791395:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788812997.791628:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322619520 00000100:00100000:3.0:1788812997.791636:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322619520 00010000:00080000:0.0:1788812997.791864:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003bef74d1 x1875706322619648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788812997.791882:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788812997.791892:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788812997.791898:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788812997.791900:0:3298:0:(import.c:65:import_set_state_nolock()) 000000008281f2dd lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788812997.791906:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003bef74d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875706322619648:0@lo:38: 00000100:00100000:3.0:1788812997.792048:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788812997.792058:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d5a180d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:3301:x1875706322619520:12345-0@lo:400: 00000100:00100000:3.0:1788812997.792120:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d5a180d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:3301:x1875706322619520:12345-0@lo:400: Request processed in 64us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788812997.792127:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788812997.792254:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000477ab934 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322619520:0@lo:400: 00010000:00010000:3.0:1788812998.751914:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788812999.772953:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788813000.270008:0:6312:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd087458b0 20000000:00000080:0.0:1788813000.270024:0:6312:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93ef1979e800 uarg=0000000000000000 20000000:01000000:0.0:1788813000.270055:0:6312:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788813000.270061:0:6312:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788813000.270065:0:6312:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788813000.270336:0:6312:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788813000.270347:0:6312:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788813000.279997:0:6312:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813000.280328:0:6312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788813000.280386:0:6312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788813000.280438:0:6312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788813000.280455:0:6312:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788813000.280485:0:6312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000061392382/0x1b294f297b1ebfb6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.280504:0:6312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ed593c99/0x1b294f297b1ebf85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ebf7e expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.280511:0:6312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000061392382/0x1b294f297b1ebfb6 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.280562:0:6312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ed593c99/0x1b294f297b1ebf85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ebf7e expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.280578:0:6312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ed593c99/0x1b294f297b1ebf85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ebf7e expref: 10 pid: 5828 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813000.280592:0:6312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be3d4bad pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6312:1875706322619776:0@lo:104: 00000100:00100000:0.0:1788813000.280660:0:6312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813000.280713:0:6312:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c4b00017 going to sleep for 11 seconds 00000100:00100000:3.0:1788813000.282155:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322619776 00000100:00100000:3.0:1788813000.282166:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322619776 00000100:00100000:3.0:1788813000.282215:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788813000.282224:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006bc73ed3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:6312:x1875706322619776:12345-0@lo:104: 00010000:00010000:3.0:1788813000.282238:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 00000000d75aa86f/0x1b294f297b1ebf7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ebf85 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.282311:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788813000.282316:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006bc73ed3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:6312:x1875706322619776:12345-0@lo:104: Request processed in 94us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813000.282322:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788813000.282345:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813000.282349:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 00000000d75aa86f/0x1b294f297b1ebf7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ebf85 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.282364:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d75aa86f already unused, calling callback (00000000e33fba64) 10000000:00010000:3.0:1788813000.282367:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 00000000d75aa86f/0x1b294f297b1ebf7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ebf85 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.282374:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 00000000d75aa86f/0x1b294f297b1ebf7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ebf85 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813000.282379:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 00000000d75aa86f/0x1b294f297b1ebf7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ebf85 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813000.282384:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788813000.282414:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 00000000d75aa86f/0x1b294f297b1ebf7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ebf85 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.282420:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813000.282443:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 00000000d75aa86f/0x1b294f297b1ebf7e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ebf85 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.282449:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 00000000d75aa86f/0x1b294f297b1ebf7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ebf85 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.282465:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813000.282468:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813000.282469:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813000.282482:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813000.282493:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b34cc68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322619904:0@lo:103: 00000100:00100000:3.0:1788813000.282525:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813000.282564:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322619904 00000100:00100000:3.0:1788813000.282567:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322619904 00010000:00010000:3.0:1788813000.282592:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ed593c99/0x1b294f297b1ebf85 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ebf7e expref: 11 pid: 5828 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813000.282614:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788813000.282619:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007648ac7d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:3301:x1875706322619904:12345-0@lo:103: 00010000:00010000:3.0:1788813000.282628:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813000.282632:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ed593c99/0x1b294f297b1ebf85 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ebf7e expref: 11 pid: 5828 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.282652:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ed593c99/0x1b294f297b1ebf85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ebf7e expref: 11 pid: 5828 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.282666:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000061392382/0x1b294f297b1ebfb6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.282674:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000061392382/0x1b294f297b1ebfb6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.282686:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000061392382/0x1b294f297b1ebfb6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.282691:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000061392382/0x1b294f297b1ebfb6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.282696:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000061392382/0x1b294f297b1ebfb6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.282701:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000061392382/0x1b294f297b1ebfb6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.282706:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000061392382 already unused, calling callback (00000000c2ea6dc3) 00010000:00010000:3.0:1788813000.282709:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000061392382/0x1b294f297b1ebfb6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.282721:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000061392382/0x1b294f297b1ebfb6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.282729:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000061392382/0x1b294f297b1ebfb6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813000.282738:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813000.282765:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007648ac7d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:3301:x1875706322619904:12345-0@lo:103: Request processed in 146us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813000.282771:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788813000.282824:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b34cc68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322619904:0@lo:103: 00010000:00010000:1.0:1788813000.283525:0:6312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ed593c99/0x1b294f297b1ebf85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ebf7e expref: 10 pid: 5828 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813000.283540:0:6312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be3d4bad pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6312:1875706322619776:0@lo:104: 00010000:00010000:1.0:1788813000.283554:0:6312:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000061392382/0x1b294f297b1ebfb6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813000.283561:0:6312:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000061392382/0x1b294f297b1ebfb6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813000.283566:0:6312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000061392382/0x1b294f297b1ebfb6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813000.283571:0:6312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000061392382/0x1b294f297b1ebfb6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813000.798701:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788813001.502700:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788813001.502710:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93ef2171d800 from 3 10000000:01000000:2.0:1788813001.502716:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788813001.502804:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 0000000068e2a1ab/0x1b294f297b1ebfbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813001.502819:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 0000000068e2a1ab/0x1b294f297b1ebfbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813001.502833:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 0000000068e2a1ab/0x1b294f297b1ebfbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813001.502863:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009dd31fb0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322620032:0@lo:101: 00000100:00100000:2.0:1788813001.502947:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813001.503005:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 0000000032ae6a52 going to sleep for 11 seconds 00000100:00100000:2.0:1788813001.503031:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322620032 00000100:00100000:2.0:1788813001.503040:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322620032 00000100:00100000:2.0:1788813001.503103:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788813001.503114:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000d7a05a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+10:5831:x1875706322620032:12345-0@lo:101: 00010000:00010000:2.0:1788813001.503130:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813001.503143:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000032a54ac6/0x1b294f297b1ebfc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ebfbd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813001.503171:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000032a54ac6/0x1b294f297b1ebfc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ebfbd expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813001.503183:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000032a54ac6/0x1b294f297b1ebfc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ebfbd expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813001.506364:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000032a54ac6, rc 0) 00000100:00100000:2.0:1788813001.506490:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000d7a05a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:5831:x1875706322620032:12345-0@lo:101: Request processed in 3374us (3539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813001.506500:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788813001.506599:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009dd31fb0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322620032:0@lo:101: 00010000:00010000:2.0:1788813001.506639:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 0000000068e2a1ab/0x1b294f297b1ebfbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ebfc4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813001.506651:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 0000000068e2a1ab/0x1b294f297b1ebfbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ebfc4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813001.506731:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009dd31fb0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322620160:0@lo:256: 00000100:00100000:2.0:1788813001.506772:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813001.506829:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 0000000032ae6a52 going to sleep for 11 seconds 00000100:00100000:2.0:1788813001.517751:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322620160 00000100:00100000:2.0:1788813001.517771:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322620160 00000100:00100000:2.0:1788813001.517861:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788813001.517872:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000963e1901 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:5831:x1875706322620160:12345-0@lo:256: 20000000:01000000:2.0:1788813001.517908:0:5829:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788813001.517929:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788813001.517932:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788813001.518252:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000963e1901 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:5831:x1875706322620160:12345-0@lo:256: Request processed in 381us (11479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813001.518260:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788813001.518619:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009dd31fb0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322620160:0@lo:256: 10000000:01000000:2.0:1788813001.518696:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788813001.518711:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 0000000068e2a1ab/0x1b294f297b1ebfbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ebfc4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813001.518724:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 0000000068e2a1ab/0x1b294f297b1ebfbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ebfc4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813001.518735:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788813001.518739:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ef2171d800 from 1 10000000:01000000:2.0:1788813001.518742:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788813001.518806:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000b02e2f70/0x1b294f297b1ebfcb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813001.518815:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000b02e2f70/0x1b294f297b1ebfcb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813001.518824:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000b02e2f70/0x1b294f297b1ebfcb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813001.518844:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009dd31fb0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322620288:0@lo:101: 00000100:00100000:2.0:1788813001.518881:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813001.518923:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 0000000032ae6a52 going to sleep for 11 seconds 00000100:00100000:2.0:1788813001.518940:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322620288 00000100:00100000:2.0:1788813001.518946:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322620288 00000100:00100000:2.0:1788813001.518972:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788813001.518980:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a397e441 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:5831:x1875706322620288:12345-0@lo:101: 00010000:00010000:2.0:1788813001.518990:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813001.519003:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008f8a99ca/0x1b294f297b1ebfd2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ebfcb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813001.519025:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008f8a99ca/0x1b294f297b1ebfd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ebfcb expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813001.519044:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008f8a99ca/0x1b294f297b1ebfd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ebfcb expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813001.519054:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008f8a99ca, rc 0) 00000100:00100000:2.0:1788813001.519085:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a397e441 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:5831:x1875706322620288:12345-0@lo:101: Request processed in 105us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813001.519090:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788813001.519120:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009dd31fb0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322620288:0@lo:101: 00010000:00010000:2.0:1788813001.519132:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000b02e2f70/0x1b294f297b1ebfcb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ebfd2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813001.519140:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000b02e2f70/0x1b294f297b1ebfcb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ebfd2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813001.519186:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009dd31fb0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322620416:0@lo:501: 00000100:00100000:2.0:1788813001.519211:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813001.519223:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 0000000032ae6a52 going to sleep for 11 seconds 00000100:00100000:2.0:1788813001.519234:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322620416 00000100:00100000:2.0:1788813001.519237:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322620416 00000100:00100000:2.0:1788813001.519256:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788813001.519262:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000095a30590 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:5831:x1875706322620416:12345-0@lo:501: 00000100:00100000:2.0:1788813001.519548:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000095a30590 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:5831:x1875706322620416:12345-0@lo:501: Request processed in 286us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813001.519556:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788813001.519587:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009dd31fb0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322620416:0@lo:501: 00000100:00100000:2.0:1788813001.519612:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009dd31fb0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322620544:0@lo:503: 00000100:00100000:2.0:1788813001.523461:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813001.523527:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 0000000032ae6a52 going to sleep for 11 seconds 00000100:00100000:1.0:1788813001.527377:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322620544 00000100:00100000:1.0:1788813001.527400:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322620544 00000100:00100000:1.0:1788813001.527476:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788813001.527486:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000065bac044 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:5831:x1875706322620544:12345-0@lo:503: 00000100:00100000:1.0:1788813001.527776:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000065bac044 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:5831:x1875706322620544:12345-0@lo:503: Request processed in 292us (4326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813001.527809:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788813001.528059:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009dd31fb0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322620544:0@lo:503: 00000100:00100000:2.0:1788813001.532023:0:6372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa9bd5ce pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6372:1875706322620672:0@lo:502: 00000100:00100000:2.0:1788813001.532130:0:6372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813001.532196:0:6372:0:(client.c:2716:ptlrpc_set_wait()) set 0000000089e1ed1d going to sleep for 11 seconds 00000100:00100000:1.0:1788813001.533362:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322620672 00000100:00100000:1.0:1788813001.533376:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322620672 00000100:00100000:1.0:1788813001.533445:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788813001.533455:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ca19bfdb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:6372:x1875706322620672:12345-0@lo:502: 00000100:00100000:1.0:1788813001.533733:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ca19bfdb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:6372:x1875706322620672:12345-0@lo:502: Request processed in 279us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813001.533742:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788813001.534338:0:6372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa9bd5ce pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6372:1875706322620672:0@lo:502: 00000020:01000000:2.0:1788813001.534380:0:6372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813001.534392:0:6372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813001.534395:0:6372:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788813001.534403:0:6372:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93ef2171d800 00000020:00000080:2.0:1788813001.534405:0:6372:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788813001.534470:0:6372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae79880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6372:1875706322620800:0@lo:502: 00000100:00100000:2.0:1788813001.534531:0:6372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813001.534573:0:6372:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e30db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788813001.539199:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322620800 00000100:00100000:3.0:1788813001.539223:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322620800 00000100:00100000:3.0:1788813001.539292:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788813001.539305:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:6372:x1875706322620800:12345-0@lo:502: 00000100:00100000:3.0:1788813001.539605:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:6372:x1875706322620800:12345-0@lo:502: Request processed in 303us (5074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813001.539614:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788813001.539918:0:6372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae79880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6372:1875706322620800:0@lo:502: 00000020:01000000:3.0:1788813001.539960:0:6372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813001.539969:0:6372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813001.539971:0:6372:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788813001.539976:0:6372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788813001.540136:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788813001.540154:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788813001.540171:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef01516e00/0x1b294f297b1ebfcb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ebfd2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813001.540184:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef01516e00/0x1b294f297b1ebfcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ebfd2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813001.821195:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813002.845398:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813002.911044:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322620928:0@lo:400: 00000100:00100000:3.0:1788813002.911146:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813002.911224:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813002.911231:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322621056:0@lo:400: 00000100:00100000:3.0:1788813002.911266:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813002.911402:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322620928 00000100:00100000:2.0:1788813002.911413:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322620928 00000100:00100000:2.0:1788813002.911466:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788813002.911476:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:3299:x1875706322620928:12345-0@lo:400: 00000100:00100000:2.0:1788813002.911548:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:3299:x1875706322620928:12345-0@lo:400: Request processed in 71us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813002.911556:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788813002.912133:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322621056 00000100:00100000:0.0:1788813002.912141:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322621056 00000100:00100000:0.0:1788813002.912194:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813002.912205:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322621056:12345-0@lo:400: 00010000:00080000:2.0:1788813002.912418:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93ef35f2fb80 x1875706322621056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813002.912436:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322621056:0@lo:400: 00000100:00100000:2.0:1788813002.912448:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322620928:0@lo:400: 00000100:00100000:0.0:1788813002.912700:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322621056:12345-0@lo:400: Request processed in 55us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813002.912709:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788813003.869221:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813004.894932:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788813005.470245:0:6673:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788813005.470249:0:6673:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788813005.470377:0:6673:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93ef197e7800 00000020:01000004:3.0:1788813005.470392:0:6673:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788813005.470404:0:6673:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788813005.470426:0:6673:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93ef35918000) 00000020:00000080:3.0:1788813005.470441:0:6673:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788813005.484953:0:6673:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788813005.485311:0:6673:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788813005.504320:0:6673:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788813005.509613:0:6673:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788813005.509648:0:6673:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788813005.509706:0:6673:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788813005.509743:0:6673:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788813005.510171:0:6673:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788813005.510181:0:6673:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788813005.510193:0:6673:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1b294f297b1ebfe0 00000020:01000004:2.0:1788813005.510201:0:6673:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788813005.510221:0:6673:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788813005.510225:0:6673:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788813005.510231:0:6673:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788813005.510235:0:6673:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788813005.510254:0:6673:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93ef355cb380) 00000020:00000080:2.0:1788813005.510265:0:6673:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788813005.511395:0:6673:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788813005.511546:0:6673:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788813005.511553:0:6673:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788813005.512373:0:6673:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788813005.512381:0:6673:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788813005.512811:0:6673:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788813005.512818:0:6673:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788813005.514367:0:6673:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813005.515030:0:6673:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788813005.515037:0:6673:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788813005.522055:0:6673:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788813005.522070:0:6673:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788813005.542373:0:6673:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788813005.542701:0:6673:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788813005.542707:0:6673:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788813005.544140:0:6673:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788813005.544151:0:6673:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788813005.545767:0:6673:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788813005.545936:0:6673:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788813005.548162:0:6673:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788813005.548353:0:6673:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788813005.548360:0:6673:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788813005.549350:0:6673:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788813005.549359:0:6673:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788813005.592749:0:6673:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788813005.593154:0:6673:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788813005.593162:0:6673:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788813005.594434:0:6673:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788813005.594453:0:6673:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788813005.595314:0:6673:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788813005.595339:0:6673:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788813005.595345:0:6673:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788813005.617359:0:6673:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788813005.617715:0:6673:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.113@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788813005.617721:0:6673:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788813005.617723:0:6673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788813005.617725:0:6673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813005.617726:0:6673:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788813005.617728:0:6673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813005.617734:0:6673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813005.617736:0:6673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788813005.617737:0:6673:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788813005.617739:0:6673:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788813005.617740:0:6673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813005.617741:0:6673:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788813005.617745:0:6673:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788813005.617747:0:6673:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788813005.617748:0:6673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788813005.617749:0:6673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813005.617750:0:6673:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788813005.617751:0:6673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813005.617752:0:6673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813005.617754:0:6673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788813005.617755:0:6673:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788813005.617756:0:6673:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788813005.617757:0:6673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813005.617758:0:6673:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788813005.617889:0:6673:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788813005.617908:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322621184:0@lo:253: 00000100:00100000:1.0:1788813005.617983:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813005.618114:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1a162540 going to sleep for 11 seconds 00000100:00100000:2.0:1788813005.618211:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322621184 00000100:00100000:2.0:1788813005.618220:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322621184 00000100:00100000:2.0:1788813005.618313:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788813005.618323:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:6673:x1875706322621184:12345-0@lo:253: 20000000:01000000:2.0:1788813005.618353:0:5828:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788813005.618358:0:5828:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788813005.618363:0:5828:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788813005.618367:0:5828:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788813005.619669:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788813005.620012:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788813005.620028:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788813005.620344:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1788813005.620354:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788813005.620386:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788813005.620436:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788813005.621328:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788813005.621352:0:5828:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:2.0:1788813005.621354:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:2.0:1788813005.621391:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788813005.621399:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788813005.621450:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788813005.621458:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:2.0:1788813005.621653:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788813005.621665:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788813005.621698:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788813005.621768:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1788813005.622953:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788813005.622978:0:5828:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:2.0:1788813005.622981:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:2.0:1788813005.623018:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788813005.623027:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788813005.623154:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788813005.623163:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:2.0:1788813005.623211:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788813005.623222:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788813005.623253:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1788813005.623289:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1788813005.623306:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788813005.623309:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788813005.623313:0:5828:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788813005.623332:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788813005.623334:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788813005.623370:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788813005.623373:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788813005.624189:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788813005.624542:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1788813005.624591:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1788813005.624682:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1788813005.624696:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788813005.624698:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788813005.625580:0:6689:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1788813005.625650:0:6689:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1788813005.625709:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788813005.626141:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788813005.626183:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788813005.626239:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788813005.626252:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788813005.626254:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788813005.627122:0:6690:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788813005.627200:0:6690:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788813005.627255:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788813005.627627:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1788813005.627667:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1788813005.627697:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1788813005.627710:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1788813005.627712:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1788813005.627721:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788813005.627740:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ef21619000/0x1b294f297b1ebfee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.627758:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef00031c00/0x1b294f297b1ebf07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ebf00 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.627765:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef00031a00/0x1b294f297b1ebf23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ebf1c expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.627772:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ebf93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ebf8c expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.627807:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ef21619000/0x1b294f297b1ebfee lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.627849:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ebf93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ebf8c expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.627863:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ebf93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ebf8c expref: 12 pid: 5827 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813005.627877:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae79c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5828:1875706322621312:0@lo:104: 00000100:00100000:2.0:1788813005.627939:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788813005.628132:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef00031a00/0x1b294f297b1ebf23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ebf1c expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.628141:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ef00031a00/0x1b294f297b1ebf23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ebf1c expref: 12 pid: 5829 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813005.628149:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5828:1875706322621440:0@lo:104: 00000100:00100000:2.0:1788813005.628171:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788813005.628345:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef00031c00/0x1b294f297b1ebf07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ebf00 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.628353:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ef00031c00/0x1b294f297b1ebf07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ebf00 expref: 12 pid: 5827 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813005.628362:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5828:1875706322621568:0@lo:104: 00000100:00100000:2.0:1788813005.628381:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813005.628418:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322621312 00000100:00100000:3.0:1788813005.628426:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322621312 00000100:00100000:3.0:1788813005.628462:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322621440 00000100:00100000:3.0:1788813005.628464:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322621440 00000100:00100000:3.0:1788813005.628501:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788813005.628509:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+4:5828:x1875706322621312:12345-0@lo:104: 00010000:00010000:3.0:1788813005.628520:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef00030000/0x1b294f297b1ebf8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ebf93 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813005.628574:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788813005.628579:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+4:5828:x1875706322621312:12345-0@lo:104: Request processed in 71us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813005.628586:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788813005.628611:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788813005.628618:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:5828:x1875706322621440:12345-0@lo:104: 00010000:00010000:3.0:1788813005.628625:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef01517600/0x1b294f297b1ebf1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ebf23 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813005.628670:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788813005.628675:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:5828:x1875706322621440:12345-0@lo:104: Request processed in 58us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813005.628681:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788813005.628819:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813005.628827:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef00030000/0x1b294f297b1ebf8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ebf93 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.628835:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef00030000 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:1.0:1788813005.628838:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef00030000/0x1b294f297b1ebf8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ebf93 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.628853:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef00030000/0x1b294f297b1ebf8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ebf93 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813005.628861:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef00030000/0x1b294f297b1ebf8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ebf93 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813005.628865:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788813005.628889:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef00030000/0x1b294f297b1ebf8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ebf93 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.628896:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813005.628914:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef00030000/0x1b294f297b1ebf8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ebf93 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.628920:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef00030000/0x1b294f297b1ebf8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ebf93 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.628934:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813005.628937:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef01517600/0x1b294f297b1ebf1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ebf23 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.628943:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef01517600 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:1.0:1788813005.628946:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef01517600/0x1b294f297b1ebf1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ebf23 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.628951:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef01517600/0x1b294f297b1ebf1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ebf23 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813005.628957:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef01517600/0x1b294f297b1ebf1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ebf23 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813005.628968:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788813005.628982:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef01517600/0x1b294f297b1ebf1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ebf23 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.628988:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813005.628993:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef01517600/0x1b294f297b1ebf1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ebf23 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.629001:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef01517600/0x1b294f297b1ebf1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ebf23 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.629010:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813005.629012:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813005.629013:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813005.629025:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322621696:0@lo:103: 00000100:00100000:1.0:1788813005.629067:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813005.629101:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813005.629107:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322621824:0@lo:103: 00000100:00100000:1.0:1788813005.629127:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813005.629158:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322621696 00000100:00100000:1.0:1788813005.629163:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322621696 00010000:00010000:1.0:1788813005.629182:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ebf93 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ebf8c expref: 13 pid: 5827 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813005.629202:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322621824 00000100:00100000:1.0:1788813005.629205:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322621824 00010000:00010000:1.0:1788813005.629215:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef00031a00/0x1b294f297b1ebf23 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ebf1c expref: 14 pid: 5829 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813005.629240:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813005.629246:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:3301:x1875706322621696:12345-0@lo:103: 00010000:00010000:1.0:1788813005.629257:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813005.629262:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ebf93 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ebf8c expref: 14 pid: 5827 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.629272:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ebf93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ebf8c expref: 14 pid: 5827 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.629287:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813005.629315:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:3301:x1875706322621696:12345-0@lo:103: Request processed in 69us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813005.629321:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813005.629335:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813005.629341:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:3301:x1875706322621824:12345-0@lo:103: 00010000:00010000:1.0:1788813005.629348:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813005.629352:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef00031a00/0x1b294f297b1ebf23 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ebf1c expref: 13 pid: 5829 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.629362:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef00031a00/0x1b294f297b1ebf23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ebf1c expref: 13 pid: 5829 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.629370:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813005.629390:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:3301:x1875706322621824:12345-0@lo:103: Request processed in 50us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813005.629396:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813005.629433:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322621824:0@lo:103: 00000100:00100000:1.0:1788813005.629450:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322621696:0@lo:103: 00000100:00100000:2.0:1788813005.629809:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3c9e3600 going to sleep for 11 seconds 00010000:00010000:2.0:1788813005.629826:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ebf93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ebf8c expref: 12 pid: 5827 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813005.629838:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae79c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5828:1875706322621312:0@lo:104: 00010000:00010000:2.0:1788813005.629857:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef00031a00/0x1b294f297b1ebf23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ebf1c expref: 11 pid: 5829 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813005.629868:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5828:1875706322621440:0@lo:104: 00000100:00100000:3.0:1788813005.629920:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322621568 00000100:00100000:3.0:1788813005.629926:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322621568 00000100:00100000:3.0:1788813005.629945:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788813005.629951:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:5828:x1875706322621568:12345-0@lo:104: 00010000:00010000:3.0:1788813005.629961:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef01516800/0x1b294f297b1ebf00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ebf07 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813005.630008:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788813005.630014:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:5828:x1875706322621568:12345-0@lo:104: Request processed in 63us (1632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813005.630029:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788813005.630154:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813005.630160:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef01516800/0x1b294f297b1ebf00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ebf07 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.630167:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef01516800 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:1.0:1788813005.630171:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef01516800/0x1b294f297b1ebf00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ebf07 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.630179:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef01516800/0x1b294f297b1ebf00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ebf07 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813005.630187:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef01516800/0x1b294f297b1ebf00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ebf07 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813005.630194:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788813005.630215:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef01516800/0x1b294f297b1ebf00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ebf07 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.630222:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813005.630239:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef01516800/0x1b294f297b1ebf00 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ebf07 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.630246:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef01516800/0x1b294f297b1ebf00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ebf07 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.630262:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813005.630264:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813005.630265:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813005.630272:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813005.630287:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322621952:0@lo:103: 00000100:00100000:1.0:1788813005.630316:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813005.630349:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322621952 00000100:00100000:1.0:1788813005.630353:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322621952 00010000:00010000:1.0:1788813005.630370:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef00031c00/0x1b294f297b1ebf07 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ebf00 expref: 11 pid: 5827 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813005.630389:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813005.630396:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:3300:x1875706322621952:12345-0@lo:103: 00010000:00010000:1.0:1788813005.630405:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813005.630410:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef00031c00/0x1b294f297b1ebf07 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ebf00 expref: 11 pid: 5827 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.630419:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef00031c00/0x1b294f297b1ebf07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ebf00 expref: 11 pid: 5827 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.630432:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ef21619000/0x1b294f297b1ebfee lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.630441:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef21619000/0x1b294f297b1ebfee lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.630456:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ef21619000/0x1b294f297b1ebfee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.630464:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ef21619000/0x1b294f297b1ebfee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.630552:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ef21619000/0x1b294f297b1ebfee lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.630561:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ef21619000/0x1b294f297b1ebfee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.630573:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619000 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:1.0:1788813005.630577:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ef21619000/0x1b294f297b1ebfee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.630586:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ef21619000/0x1b294f297b1ebfee lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.630595:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ef21619000/0x1b294f297b1ebfee lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.630618:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813005.630648:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:3300:x1875706322621952:12345-0@lo:103: Request processed in 252us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813005.630654:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813005.630682:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322621952:0@lo:103: 00010000:00010000:2.0:1788813005.631021:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef00031c00/0x1b294f297b1ebf07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ebf00 expref: 10 pid: 5827 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813005.631032:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5828:1875706322621568:0@lo:104: 00010000:00010000:2.0:1788813005.631129:0:5828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ef21619000/0x1b294f297b1ebfee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.631139:0:5828:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ef21619000/0x1b294f297b1ebfee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.631145:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ef21619000/0x1b294f297b1ebfee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.631150:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef21619000/0x1b294f297b1ebfee lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788813005.631163:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1788813005.631327:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813005.668882:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+9:6673:x1875706322621184:12345-0@lo:253: Request processed in 50553us (50892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813005.668896:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788813005.669000:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322621184:0@lo:253: 10000000:01000000:1.0:1788813005.669016:0:6673:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788813005.669019:0:6673:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788813005.669021:0:6673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788813005.669022:0:6673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813005.669024:0:6673:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788813005.669025:0:6673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813005.669026:0:6673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813005.669028:0:6673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788813005.669029:0:6673:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788813005.669031:0:6673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813005.669032:0:6673:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788813005.669061:0:6673:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93ef197e7800 from lustre-OST0000 10000000:01000000:1.0:1788813005.669086:0:6673:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788813005.669089:0:6673:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788813005.669106:0:6673:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93ef2a35b380 local copy 10000000:01000000:1.0:1788813005.669111:0:6673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788813005.669145:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214ce00/0x1b294f297b1ebff5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.669156:0:6673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.113@tcp lock: ffff93ef4214ce00/0x1b294f297b1ebff5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.669166:0:6673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef4214ce00/0x1b294f297b1ebff5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813005.669182:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322622080:0@lo:101: 00000100:00100000:1.0:1788813005.669215:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813005.669269:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e101b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788813005.669404:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322622080 00000100:00100000:2.0:1788813005.669411:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322622080 00000100:00100000:2.0:1788813005.669455:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788813005.669462:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+9:6673:x1875706322622080:12345-0@lo:101: 00010000:00010000:2.0:1788813005.669474:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813005.669496:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef21619000/0x1b294f297b1ebffc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ebff5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.669519:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef21619000/0x1b294f297b1ebffc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ebff5 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.669537:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef21619000/0x1b294f297b1ebffc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ebff5 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.669546:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619000, rc 0) 00000100:00100000:2.0:1788813005.669584:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+10:6673:x1875706322622080:12345-0@lo:101: Request processed in 122us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813005.669591:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788813005.669900:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322622080:0@lo:101: 00010000:00010000:1.0:1788813005.669914:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef4214ce00/0x1b294f297b1ebff5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1b294f297b1ebffc expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.669923:0:6673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef4214ce00/0x1b294f297b1ebff5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1b294f297b1ebffc expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813005.670013:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322622208:0@lo:501: 00000100:00100000:1.0:1788813005.670038:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813005.670131:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e101b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788813005.670182:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322622208 00000100:00100000:3.0:1788813005.670187:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322622208 00000100:00100000:3.0:1788813005.670220:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788813005.670227:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+10:6673:x1875706322622208:12345-0@lo:501: 00000100:00100000:3.0:1788813005.670429:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+10:6673:x1875706322622208:12345-0@lo:501: Request processed in 202us (390us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788813005.670437:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788813005.670746:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322622208:0@lo:501: 10000000:01000000:1.0:1788813005.670759:0:6673:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788813005.670822:0:6673:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788813005.670828:0:6673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214ce00/0x1b294f297b1ebff5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1b294f297b1ebffc expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.670843:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214ce00/0x1b294f297b1ebff5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1b294f297b1ebffc expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.670851:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff93ef4214ce00/0x1b294f297b1ebff5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1b294f297b1ebffc expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.670867:0:6673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788813005.670886:0:6673:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93ef197e7800 10000000:01000000:1.0:1788813005.670891:0:6673:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788813005.670895:0:6673:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93ef2a35b380 10000000:01000000:1.0:1788813005.670897:0:6673:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788813005.670900:0:6673:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff93ef2a35b380 from 1 10000000:01000000:1.0:1788813005.670903:0:6673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788813005.670922:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214c400/0x1b294f297b1ec003 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.670930:0:6673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef4214c400/0x1b294f297b1ec003 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.670937:0:6673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef4214c400/0x1b294f297b1ec003 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813005.670950:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322622336:0@lo:101: 00000100:00100000:1.0:1788813005.670980:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813005.671012:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e1016c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813005.671074:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322622336 00000100:00100000:3.0:1788813005.671079:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322622336 00000100:00100000:3.0:1788813005.671121:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788813005.671128:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+10:6673:x1875706322622336:12345-0@lo:101: 00010000:00010000:3.0:1788813005.671137:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813005.671149:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef1164ea00/0x1b294f297b1ec00a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec003 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813005.671166:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef1164ea00/0x1b294f297b1ec00a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec003 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813005.671176:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef1164ea00/0x1b294f297b1ec00a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec003 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813005.671184:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164ea00, rc 0) 00000100:00100000:3.0:1788813005.671210:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:6673:x1875706322622336:12345-0@lo:101: Request processed in 82us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813005.671224:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788813005.671491:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322622336:0@lo:101: 00010000:00010000:1.0:1788813005.671503:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef4214c400/0x1b294f297b1ec003 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec00a expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.671521:0:6673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef4214c400/0x1b294f297b1ec003 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec00a expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813005.671537:0:6673:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788813005.671553:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214c400/0x1b294f297b1ec003 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec00a expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.671560:0:6673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef4214c400/0x1b294f297b1ec003 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec00a expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813005.671566:0:6673:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788813005.671570:0:6673:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788813005.671573:0:6673:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788813005.671575:0:6673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788813005.671590:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214de00/0x1b294f297b1ec011 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.671596:0:6673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef4214de00/0x1b294f297b1ec011 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.671615:0:6673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef4214de00/0x1b294f297b1ec011 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813005.671626:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322622464:0@lo:101: 00000100:00100000:1.0:1788813005.671653:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813005.671666:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e1016c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788813005.671724:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813005.671731:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef4214ce00/0x1b294f297b1ebff5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1b294f297b1ebffc expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.671739:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214ce00 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:2.0:1788813005.671743:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214ce00/0x1b294f297b1ebff5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1b294f297b1ebffc expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.671751:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef4214ce00/0x1b294f297b1ebff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x1b294f297b1ebffc expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813005.671758:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214ce00/0x1b294f297b1ebff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x1b294f297b1ebffc expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813005.671764:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788813005.671811:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef4214ce00/0x1b294f297b1ebff5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1b294f297b1ebffc expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.671818:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813005.671832:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef4214ce00/0x1b294f297b1ebff5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1b294f297b1ebffc expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.671849:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef4214ce00/0x1b294f297b1ebff5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1b294f297b1ebffc expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.671861:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813005.671863:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813005.671865:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813005.671873:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813005.671883:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322622592:0@lo:103: 00000100:00100000:2.0:1788813005.671912:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813005.671942:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322622464 00000100:00100000:2.0:1788813005.671946:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322622464 00000100:00100000:2.0:1788813005.671973:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788813005.671979:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:6673:x1875706322622464:12345-0@lo:101: 00010000:00010000:2.0:1788813005.671987:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813005.671995:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef21618600/0x1b294f297b1ec018 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec011 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.672009:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef21618600/0x1b294f297b1ec018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec011 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.672018:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef21618600/0x1b294f297b1ec018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec011 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.672025:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21618600, rc 0) 00000100:00100000:2.0:1788813005.672123:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:6673:x1875706322622464:12345-0@lo:101: Request processed in 143us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813005.672129:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788813005.672200:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322622592 00000100:00100000:1.0:1788813005.672204:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322622592 00000100:00100000:1.0:1788813005.672247:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813005.672254:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:3299:x1875706322622592:12345-0@lo:103: 00010000:00010000:1.0:1788813005.672263:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813005.672273:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef21619000/0x1b294f297b1ebffc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b294f297b1ebff5 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.672282:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813005.672311:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:3299:x1875706322622592:12345-0@lo:103: Request processed in 58us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813005.672317:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813005.672344:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322622592:0@lo:103: 00000100:00100000:1.0:1788813005.672365:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322622464:0@lo:101: 00010000:00010000:1.0:1788813005.672376:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef4214de00/0x1b294f297b1ec011 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec018 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.672384:0:6673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef4214de00/0x1b294f297b1ec011 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec018 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813005.672469:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322622720:0@lo:501: 00000100:00100000:1.0:1788813005.672494:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813005.672508:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e1016c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813005.672522:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322622720 00000100:00100000:1.0:1788813005.672526:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322622720 00000100:00100000:1.0:1788813005.672548:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788813005.672554:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:6673:x1875706322622720:12345-0@lo:501: 00000100:00100000:1.0:1788813005.672821:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:6673:x1875706322622720:12345-0@lo:501: Request processed in 266us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813005.672838:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788813005.672885:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322622720:0@lo:501: 00000100:00100000:1.0:1788813005.672909:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322622848:0@lo:503: 00000100:00100000:1.0:1788813005.672944:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813005.672956:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e1016c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813005.673023:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322622848 00000100:00100000:2.0:1788813005.673032:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322622848 00000100:00100000:2.0:1788813005.673071:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788813005.673078:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:6673:x1875706322622848:12345-0@lo:503: 00000100:00100000:2.0:1788813005.673210:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:6673:x1875706322622848:12345-0@lo:503: Request processed in 132us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813005.673216:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788813005.673344:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322622848:0@lo:503: 00000040:00080000:1.0:1788813005.673583:0:6673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788813005.673653:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322622976:0@lo:502: 00000100:00100000:1.0:1788813005.673687:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813005.673717:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e1016c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813005.673928:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322622976 00000100:00100000:2.0:1788813005.673934:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322622976 00000100:00100000:2.0:1788813005.674001:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788813005.674008:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:6673:x1875706322622976:12345-0@lo:502: 00000100:00100000:2.0:1788813005.674154:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:6673:x1875706322622976:12345-0@lo:502: Request processed in 146us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813005.674161:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788813005.674219:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322622976:0@lo:502: 00000040:00080000:1.0:1788813005.674462:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788813005.674512:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788813005.674548:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788813005.674596:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788813005.674647:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788813005.674680:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788813005.674703:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322623104:0@lo:502: 00000100:00100000:1.0:1788813005.674738:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813005.675031:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e1016c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813005.675150:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322623104 00000100:00100000:3.0:1788813005.675155:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322623104 00000100:00100000:3.0:1788813005.675181:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788813005.675188:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:6673:x1875706322623104:12345-0@lo:502: 00000100:00100000:3.0:1788813005.675354:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:6673:x1875706322623104:12345-0@lo:502: Request processed in 165us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813005.675361:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788813005.675435:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322623104:0@lo:502: 00000040:00080000:1.0:1788813005.675520:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788813005.675531:0:6673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1788813005.676019:0:6691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788813005.676026:0:6691:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788813005.676032:0:6691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813005.676040:0:6691:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788813005.676056:0:6691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788813005.676069:0:6691:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93ef2a3599c0) 00000020:00000080:1.0:1788813005.676087:0:6691:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788813005.676092:0:6691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788813005.676150:0:6691:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93ef197e7800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788813005.676157:0:6691:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788813005.676164:0:6691:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1b294f297b1ec026 00010000:00010000:1.0:1788813005.679212:0:6691:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1788813005.679509:0:6691:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788813005.682225:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788813005.682484:0:6691:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788813005.692275:0:6691:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788813005.692734:0:6691:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788813005.695521:0:6691:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788813005.695534:0:6691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813005.695542:0:6691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813005.695544:0:6691:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788813005.695549:0:6691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813005.695553:0:6691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813005.695555:0:6691:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788813005.695558:0:6691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788813005.695560:0:6691:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788813005.695625:0:6691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813005.695629:0:6691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813005.695631:0:6691:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788813005.695635:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788813005.696291:0:6673:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788813005.696316:0:6673:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788813005.696348:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214de00/0x1b294f297b1ec011 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec018 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.696361:0:6673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef4214de00/0x1b294f297b1ec011 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec018 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813005.696370:0:6673:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ef197e7800 from 1 10000000:01000000:2.0:1788813005.696372:0:6673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788813005.696406:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ec02d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.696415:0:6673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ec02d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.696425:0:6673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ec02d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813005.696448:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322623232:0@lo:101: 00000100:00100000:2.0:1788813005.696511:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813005.696559:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef12685600 going to sleep for 11 seconds 00000100:00100000:3.0:1788813005.696643:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322623232 00000100:00100000:3.0:1788813005.696650:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322623232 00000100:00100000:3.0:1788813005.696698:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788813005.696708:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:6673:x1875706322623232:12345-0@lo:101: 00010000:00010000:3.0:1788813005.696722:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813005.696733:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef1164f800/0x1b294f297b1ec034 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec02d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813005.696756:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef1164f800/0x1b294f297b1ec034 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec02d expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813005.696768:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef1164f800/0x1b294f297b1ec034 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec02d expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813005.696776:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164f800, rc 0) 00000100:00100000:3.0:1788813005.696834:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:6673:x1875706322623232:12345-0@lo:101: Request processed in 128us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813005.696841:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788813005.696951:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322623232:0@lo:101: 00010000:00010000:2.0:1788813005.696965:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ec02d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec034 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.696975:0:6673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ec02d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec034 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813005.697132:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322623360:0@lo:501: 00000100:00100000:2.0:1788813005.697158:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813005.697186:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef12685600 going to sleep for 11 seconds 00000100:00100000:3.0:1788813005.697286:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322623360 00000100:00100000:3.0:1788813005.697291:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322623360 00000100:00100000:3.0:1788813005.697325:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788813005.697331:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:6673:x1875706322623360:12345-0@lo:501: 00000100:00100000:3.0:1788813005.697538:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:6673:x1875706322623360:12345-0@lo:501: Request processed in 207us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813005.697545:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788813005.697626:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae79c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322623360:0@lo:501: 00000100:00100000:0.0:1788813005.697658:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322623488:0@lo:503: 00000100:00100000:0.0:1788813005.697703:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813005.697726:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef10a23600 going to sleep for 11 seconds 00000100:00100000:2.0:1788813005.697768:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322623488 00000100:00100000:2.0:1788813005.697773:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322623488 00000100:00100000:2.0:1788813005.697830:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788813005.697836:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:6673:x1875706322623488:12345-0@lo:503: 00000100:00100000:2.0:1788813005.698042:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:6673:x1875706322623488:12345-0@lo:503: Request processed in 205us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813005.698118:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788813005.698203:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322623488:0@lo:503: 00000040:00080000:0.0:1788813005.698490:0:6673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788813005.698553:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322623616:0@lo:502: 00000100:00100000:0.0:1788813005.698590:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813005.698629:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef10a23600 going to sleep for 11 seconds 00000100:00100000:3.0:1788813005.698687:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322623616 00000100:00100000:3.0:1788813005.698692:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322623616 00000100:00100000:3.0:1788813005.698721:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788813005.698728:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:6673:x1875706322623616:12345-0@lo:502: 00000100:00100000:3.0:1788813005.698924:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:6673:x1875706322623616:12345-0@lo:502: Request processed in 196us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813005.698932:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788813005.699135:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322623616:0@lo:502: 00000040:00080000:0.0:1788813005.699350:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788813005.699399:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788813005.699421:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322623744:0@lo:502: 00000100:00100000:0.0:1788813005.699454:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813005.699470:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef10a23600 going to sleep for 11 seconds 00000100:00100000:3.0:1788813005.699520:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322623744 00000100:00100000:3.0:1788813005.699525:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322623744 00000100:00100000:3.0:1788813005.699555:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788813005.699562:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21325850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:6673:x1875706322623744:12345-0@lo:502: 00000100:00100000:3.0:1788813005.699690:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21325850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:6673:x1875706322623744:12345-0@lo:502: Request processed in 128us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813005.699697:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788813005.699806:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322623744:0@lo:502: 00000040:00080000:0.0:1788813005.699879:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788813005.699888:0:6673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788813005.703421:0:6695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813005.703433:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813005.703435:0:6695:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788813005.703442:0:6695:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93ef197e7800 00000020:00000080:2.0:1788813005.703445:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788813005.703464:0:6695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813005.703468:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813005.703469:0:6695:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788813005.703472:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788813005.703610:0:6673:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788813005.703635:0:6673:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788813005.703658:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ec02d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec034 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813005.703670:0:6673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ec02d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec034 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813005.703712:0:6673:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788813005.703721:0:6673:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93ef197e7800 10000000:01000000:3.0:1788813005.703724:0:6673:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93ef197e7800 10000000:01000000:3.0:1788813005.703728:0:6673:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788813005.703733:0:6673:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93ef197e7800 from 1 10000000:01000000:3.0:1788813005.703736:0:6673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788813005.703770:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164f600/0x1b294f297b1ec03b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813005.703806:0:6673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef1164f600/0x1b294f297b1ec03b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813005.703819:0:6673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef1164f600/0x1b294f297b1ec03b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813005.703842:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322623872:0@lo:101: 00000100:00100000:3.0:1788813005.703907:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813005.703944:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322623872 00000100:00100000:3.0:1788813005.703951:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322623872 00000100:00100000:3.0:1788813005.703993:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788813005.704002:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21327850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:6673:x1875706322623872:12345-0@lo:101: 00010000:00010000:3.0:1788813005.704015:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813005.704025:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef1164e800/0x1b294f297b1ec042 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec03b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813005.704173:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef1164e800/0x1b294f297b1ec042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec03b expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813005.704186:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef1164e800/0x1b294f297b1ec042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec03b expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813005.704195:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164e800, rc 0) 00000100:00100000:3.0:1788813005.704234:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21327850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:6673:x1875706322623872:12345-0@lo:101: Request processed in 233us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813005.704241:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788813005.704280:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee01093cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813005.704299:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322623872:0@lo:101: 00010000:00010000:3.0:1788813005.704312:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef1164f600/0x1b294f297b1ec03b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec042 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813005.704321:0:6673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef1164f600/0x1b294f297b1ec03b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec042 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813005.704397:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322624000:0@lo:501: 00000100:00100000:3.0:1788813005.704420:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813005.704431:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee01093cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813005.704516:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322624000 00000100:00100000:2.0:1788813005.704521:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322624000 00000100:00100000:2.0:1788813005.704543:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788813005.704550:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21326050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:6673:x1875706322624000:12345-0@lo:501: 00000100:00100000:2.0:1788813005.704763:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21326050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:6673:x1875706322624000:12345-0@lo:501: Request processed in 214us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813005.704770:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788813005.704902:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322624000:0@lo:501: 00000100:00100000:3.0:1788813005.704927:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322624128:0@lo:503: 00000100:00100000:3.0:1788813005.704962:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813005.704988:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee01093cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813005.705029:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322624128 00000100:00100000:2.0:1788813005.705033:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322624128 00000100:00100000:2.0:1788813005.705131:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788813005.705139:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:6673:x1875706322624128:12345-0@lo:503: 00000100:00100000:2.0:1788813005.705268:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:6673:x1875706322624128:12345-0@lo:503: Request processed in 130us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813005.705281:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788813005.705349:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322624128:0@lo:503: 00000040:00080000:3.0:1788813005.705585:0:6673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788813005.705663:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322624256:0@lo:502: 00000100:00100000:3.0:1788813005.705694:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813005.705717:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee01093cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813005.705760:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322624256 00000100:00100000:2.0:1788813005.705765:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322624256 00000100:00100000:2.0:1788813005.705885:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788813005.705893:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:6673:x1875706322624256:12345-0@lo:502: 00000100:00100000:2.0:1788813005.706041:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:6673:x1875706322624256:12345-0@lo:502: Request processed in 148us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813005.706217:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788813005.706259:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322624256:0@lo:502: 00000040:00080000:2.0:1788813005.706499:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788813005.706547:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788813005.706587:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788813005.706652:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788813005.706690:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788813005.706739:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788813005.706776:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788813005.706847:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788813005.706894:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788813005.706931:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788813005.706965:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788813005.707013:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788813005.707125:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788813005.707161:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788813005.707205:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788813005.707242:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788813005.707276:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788813005.707867:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788813005.707938:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788813005.707975:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788813005.708039:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788813005.708151:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788813005.708186:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788813005.708234:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788813005.708270:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788813005.708306:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788813005.708355:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788813005.708391:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788813005.708435:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322624384:0@lo:502: 00000100:00100000:2.0:1788813005.708503:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813005.708551:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef30167e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788813005.709745:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322624384 00000100:00100000:0.0:1788813005.709755:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322624384 00000100:00100000:0.0:1788813005.709830:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788813005.709840:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21326c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:6673:x1875706322624384:12345-0@lo:502: 00000100:00100000:0.0:1788813005.710590:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21326c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:6673:x1875706322624384:12345-0@lo:502: Request processed in 749us (2084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813005.710609:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788813005.710712:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322624384:0@lo:502: 00000040:00080000:3.0:1788813005.710843:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788813005.710858:0:6673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788813005.712219:0:6696:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788813005.712251:0:6696:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93ef119e0000) 00000020:00000080:1.0:1788813005.712277:0:6696:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1788813005.712363:0:6696:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93ef197e7800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788813005.712367:0:6696:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93ef197e7800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788813005.712370:0:6696:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ef197e7800 3 00010000:00080000:1.0:1788813005.712404:0:6696:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93ee04b97000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1788813005.714709:0:6696:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1788813005.715212:0:6696:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788813005.715245:0:6696:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788813005.715259:0:6696:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1b294f297b1ec050 00000100:00080000:1.0:1788813005.715268:0:6696:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788813005.715279:0:6696:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93ee04b97000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1788813005.715311:0:6696:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ef20e4ce00 x1875706322624512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788813005.715363:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1875706322624512:0@lo:38: 00000100:00100000:0.0:1788813005.715427:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813005.715537:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322624512 00000100:00100000:1.0:1788813005.715545:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322624512 00000100:00100000:1.0:1788813005.715585:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813005.715592:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1875706322624512:12345-0@lo:38: 00010000:00080000:1.0:1788813005.715630:0:5834:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:1.0:1788813005.715660:0:5834:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1b294f297b1ec057 00000004:00100000:1.0:1788813005.715674:0:5834:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788813005.715702:0:5834:0:(import.c:65:import_set_state_nolock()) ffff93ef1978d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813005.717957:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875706322624512:12345-0@lo:38: Request processed in 2356us (2521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813005.717969:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788813005.718672:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93ef20e4ce00 x1875706322624512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813005.718686:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788813005.718696:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788813005.718704:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788813005.718709:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788813005.718719:0:3298:0:(import.c:65:import_set_state_nolock()) ffff93ee04b97000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788813005.718725:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1875706322624512:0@lo:38: 00000100:00080000:1.0:1788813005.720948:0:6696:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788813005.721352:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322624640:0@lo:400: 00000100:00100000:1.0:1788813005.721424:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813005.721480:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322624640 00000100:00100000:0.0:1788813005.721489:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322624640 00000100:00100000:0.0:1788813005.721541:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788813005.721550:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322624640:12345-0@lo:400: 00000100:00100000:0.0:1788813005.721620:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322624640:12345-0@lo:400: Request processed in 71us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813005.721627:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788813005.721743:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93ef35a1ca80 x1875706322624640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813005.721757:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322624640:0@lo:400: 00000040:00080000:2.0:1788813005.722150:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1788813005.722425:0:6673:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788813005.722462:0:6673:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788813005.722517:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164f600/0x1b294f297b1ec03b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec042 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813005.722530:0:6673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef1164f600/0x1b294f297b1ec03b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec042 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788813005.722576:0:6673:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788813005.722578:0:6673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788813005.722580:0:6673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813005.722581:0:6673:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813005.722582:0:6673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813005.722584:0:6673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813005.722585:0:6673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788813005.722587:0:6673:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788813005.722588:0:6673:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788813005.722590:0:6673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813005.722591:0:6673:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788813005.722595:0:6673:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788813005.722609:0:6673:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788813005.722611:0:6673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788813005.722613:0:6673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813005.722614:0:6673:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813005.722615:0:6673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813005.722617:0:6673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813005.722619:0:6673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788813005.722620:0:6673:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788813005.722621:0:6673:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788813005.722623:0:6673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813005.722624:0:6673:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788813005.722643:0:6673:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788813005.722655:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322624768:0@lo:253: 00000100:00100000:3.0:1788813005.722700:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813005.722735:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee01093c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813005.722960:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322624768 00000100:00100000:0.0:1788813005.722968:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322624768 00000100:00100000:0.0:1788813005.723006:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788813005.723016:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:6673:x1875706322624768:12345-0@lo:253: 20000000:01000000:0.0:1788813005.723039:0:5828:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788813005.723053:0:5828:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788813005.759130:0:5828:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788813005.760708:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788813005.760821:0:5850:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788813005.760827:0:5850:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788813005.760850:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ef21618e00/0x1b294f297b1ec05e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.760869:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef01517800/0x1b294f297b1ebfc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ebfbd expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.760877:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ef21618e00/0x1b294f297b1ec05e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.760919:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef01517800/0x1b294f297b1ebfc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ebfbd expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.760934:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ef01517800/0x1b294f297b1ebfc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ebfbd expref: 13 pid: 5827 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813005.760947:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5850:1875706322624896:0@lo:104: 00000100:00100000:2.0:1788813005.761010:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813005.763958:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef20e1f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813005.767736:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322624896 00000100:00100000:0.0:1788813005.767750:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322624896 00000100:00100000:0.0:1788813005.767812:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788813005.767821:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:5850:x1875706322624896:12345-0@lo:104: 00010000:00010000:0.0:1788813005.767837:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef01517400/0x1b294f297b1ebfbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ebfc4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813005.767940:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788813005.767946:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:5850:x1875706322624896:12345-0@lo:104: Request processed in 127us (6937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813005.767952:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788813005.768023:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5850:1875706322624896:0@lo:104: 00010000:00010000:2.0:1788813005.768047:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ef21618e00/0x1b294f297b1ec05e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.769166:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813005.769176:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef01517400/0x1b294f297b1ebfbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ebfc4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.769186:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef01517400 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:1.0:1788813005.769191:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef01517400/0x1b294f297b1ebfbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ebfc4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.769201:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef01517400/0x1b294f297b1ebfbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ebfc4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813005.769210:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef01517400/0x1b294f297b1ebfbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ebfc4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813005.769229:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788813005.769274:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef01517400/0x1b294f297b1ebfbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ebfc4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.769281:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813005.769304:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef01517400/0x1b294f297b1ebfbd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ebfc4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.769312:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef01517400/0x1b294f297b1ebfbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ebfc4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.769330:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813005.769332:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813005.769335:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813005.769336:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322625024:0@lo:103: 00000100:00100000:3.0:1788813005.769392:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813005.769717:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322625024 00000100:00100000:1.0:1788813005.769724:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322625024 00010000:00010000:1.0:1788813005.769747:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef01517800/0x1b294f297b1ebfc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ebfbd expref: 14 pid: 5827 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813005.769821:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813005.769831:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07822c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:3302:x1875706322625024:12345-0@lo:103: 00010000:00010000:1.0:1788813005.769841:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813005.769857:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef01517800/0x1b294f297b1ebfc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ebfbd expref: 14 pid: 5827 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.769869:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef01517800/0x1b294f297b1ebfc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ebfbd expref: 14 pid: 5827 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.769882:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef01517800/0x1b294f297b1ebfc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ebfbd expref: 14 pid: 5827 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.769904:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ef21618e00/0x1b294f297b1ec05e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.769913:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef21618e00/0x1b294f297b1ec05e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788813005.769929:0:5818:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009102214s 00010000:00010000:1.0:1788813005.769934:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ef21618e00/0x1b294f297b1ec05e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.769942:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ef21618e00/0x1b294f297b1ec05e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.769949:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ef21618e00/0x1b294f297b1ec05e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.769956:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ef21618e00/0x1b294f297b1ec05e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.769963:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618e00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:1.0:1788813005.769967:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ef21618e00/0x1b294f297b1ec05e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.769975:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ef21618e00/0x1b294f297b1ec05e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.769989:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ef21618e00/0x1b294f297b1ec05e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813005.770000:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813005.770010:0:5850:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ef21618e00/0x1b294f297b1ec05e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.770022:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ef21618e00/0x1b294f297b1ec05e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813005.770029:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef21618e00/0x1b294f297b1ec05e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813005.770051:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07822c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:3302:x1875706322625024:12345-0@lo:103: Request processed in 221us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813005.770059:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813005.770121:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322625024:0@lo:103: 00000100:00100000:0.0:1788813005.779122:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:6673:x1875706322624768:12345-0@lo:253: Request processed in 56099us (56413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813005.779138:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788813005.779341:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6673:1875706322624768:0@lo:253: 10000000:01000000:3.0:1788813005.779356:0:6673:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788813005.779359:0:6673:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788813005.779361:0:6673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788813005.779363:0:6673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813005.779364:0:6673:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813005.779365:0:6673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813005.779366:0:6673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813005.779368:0:6673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788813005.779369:0:6673:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788813005.779371:0:6673:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788813005.779373:0:6673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813005.779374:0:6673:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788813005.779388:0:6673:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788813005.787861:0:6673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788813005.788174:0:6673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788813005.788421:0:6673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788813005.789055:0:6673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788813005.789311:0:6673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788813005.789558:0:6673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788813005.791159:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1788813005.916897:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788813005.954513:0:6673:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788813005.954521:0:6673:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788813005.954562:0:6673:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788813005.954635:0:6673:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788813005.954651:0:6673:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788813005.954681:0:6673:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788813006.940985:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788813006.941493:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788813006.941498:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93ef2171d800 from 21 10000000:01000000:1.0:1788813006.941505:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788813006.941569:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214d800/0x1b294f297b1ec065 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813006.941583:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef4214d800/0x1b294f297b1ec065 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813006.941606:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef4214d800/0x1b294f297b1ec065 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813006.941637:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322625152:0@lo:101: 00000100:00100000:1.0:1788813006.942272:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813006.942488:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef126220c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813006.942914:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322625152 00000100:00100000:0.0:1788813006.942925:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322625152 00000100:00100000:0.0:1788813006.942997:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788813006.943009:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21326850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:5831:x1875706322625152:12345-0@lo:101: 00010000:00010000:0.0:1788813006.943027:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813006.943046:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef00030e00/0x1b294f297b1ec06c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec065 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813006.943080:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef00030e00/0x1b294f297b1ec06c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec065 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813006.943092:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef00030e00/0x1b294f297b1ec06c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec065 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813006.943102:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef00030e00, rc 0) 00000100:00100000:0.0:1788813006.943232:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21326850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:5831:x1875706322625152:12345-0@lo:101: Request processed in 225us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813006.943238:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788813006.943383:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322625152:0@lo:101: 00010000:00010000:1.0:1788813006.943403:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef4214d800/0x1b294f297b1ec065 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec06c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813006.943414:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef4214d800/0x1b294f297b1ec065 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec06c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813006.943489:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322625280:0@lo:501: 00000100:00100000:1.0:1788813006.943544:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813006.943581:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef126220c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813006.943821:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322625280 00000100:00100000:0.0:1788813006.943828:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322625280 00000100:00100000:0.0:1788813006.943861:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788813006.943870:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21325450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:5831:x1875706322625280:12345-0@lo:501: 00000100:00100000:0.0:1788813006.944170:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21325450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:5831:x1875706322625280:12345-0@lo:501: Request processed in 301us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813006.944178:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788813006.944262:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322625280:0@lo:501: 00000100:00100000:1.0:1788813006.944298:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322625408:0@lo:503: 00000100:00100000:1.0:1788813006.944340:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813006.944626:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef126220c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813006.945187:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322625408 00000100:00100000:2.0:1788813006.945197:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322625408 00000100:00100000:2.0:1788813006.945248:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788813006.945259:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:5831:x1875706322625408:12345-0@lo:503: 00000100:00100000:2.0:1788813006.945864:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:5831:x1875706322625408:12345-0@lo:503: Request processed in 605us (1521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813006.945882:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788813006.946048:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322625408:0@lo:503: 00000100:00100000:2.0:1788813006.946607:0:6769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6769:1875706322625536:0@lo:502: 00000100:00100000:2.0:1788813006.946735:0:6769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813006.946857:0:6769:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef18de0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813006.946939:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322625536 00000100:00100000:0.0:1788813006.946953:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322625536 00000100:00100000:0.0:1788813006.947041:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788813006.947052:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21325c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:6769:x1875706322625536:12345-0@lo:502: 00000100:00100000:0.0:1788813006.947361:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21325c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:6769:x1875706322625536:12345-0@lo:502: Request processed in 310us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813006.947441:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788813006.947658:0:6769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6769:1875706322625536:0@lo:502: 00000100:00100000:2.0:1788813006.947831:0:6769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6769:1875706322625664:0@lo:502: 00000100:00100000:2.0:1788813006.947879:0:6769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813006.947912:0:6769:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef18de0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788813006.947935:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322625664 00000100:00100000:3.0:1788813006.947941:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322625664 00000100:00100000:3.0:1788813006.947976:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788813006.947989:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21327050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:6769:x1875706322625664:12345-0@lo:502: 00000100:00100000:3.0:1788813006.948370:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21327050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:6769:x1875706322625664:12345-0@lo:502: Request processed in 381us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813006.948378:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788813006.949009:0:6769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6769:1875706322625664:0@lo:502: 00000040:00080000:2.0:1788813006.949046:0:6769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788813006.949660:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788813006.949755:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788813006.949769:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214d800/0x1b294f297b1ec065 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec06c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813006.949939:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef4214d800/0x1b294f297b1ec065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec06c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813006.949952:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788813006.949955:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93ef2171d800 from 4 10000000:01000000:1.0:1788813006.949958:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788813006.950004:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214ca00/0x1b294f297b1ec073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813006.950013:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef4214ca00/0x1b294f297b1ec073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813006.950024:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef4214ca00/0x1b294f297b1ec073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813006.950046:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322625792:0@lo:101: 00000100:00100000:1.0:1788813006.950132:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813006.950289:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef126220c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813006.951169:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322625792 00000100:00100000:0.0:1788813006.951182:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322625792 00000100:00100000:0.0:1788813006.951326:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788813006.951339:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:5831:x1875706322625792:12345-0@lo:101: 00010000:00010000:0.0:1788813006.951359:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813006.951381:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef00031e00/0x1b294f297b1ec07a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec073 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813006.951414:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef00031e00/0x1b294f297b1ec07a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec073 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813006.951427:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef00031e00/0x1b294f297b1ec07a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec073 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813006.951494:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef00031e00, rc 0) 00000100:00100000:0.0:1788813006.951657:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:5831:x1875706322625792:12345-0@lo:101: Request processed in 321us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813006.951664:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788813006.951985:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322625792:0@lo:101: 00010000:00010000:1.0:1788813006.952009:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef4214ca00/0x1b294f297b1ec073 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec07a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813006.952021:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef4214ca00/0x1b294f297b1ec073 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec07a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813006.952103:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322625920:0@lo:256: 00000100:00100000:1.0:1788813006.952165:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813006.952622:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef126220c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813006.952903:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322625920 00000100:00100000:3.0:1788813006.952912:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322625920 00000100:00100000:3.0:1788813006.952956:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788813006.952967:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21326450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:5831:x1875706322625920:12345-0@lo:256: 20000000:01000000:3.0:1788813006.952991:0:5827:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788813006.953014:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788813006.953017:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788813006.953142:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21326450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:5831:x1875706322625920:12345-0@lo:256: Request processed in 176us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813006.953157:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788813006.953313:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322625920:0@lo:256: 10000000:01000000:1.0:1788813006.953368:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788813006.953377:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214ca00/0x1b294f297b1ec073 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec07a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813006.953387:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef4214ca00/0x1b294f297b1ec073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec07a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813006.953397:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788813006.953401:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788813006.953404:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788813006.953443:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214c200/0x1b294f297b1ec081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813006.953452:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef4214c200/0x1b294f297b1ec081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813006.953473:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef4214c200/0x1b294f297b1ec081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813006.953491:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322626048:0@lo:101: 00000100:00100000:1.0:1788813006.953525:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813006.953559:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef126220c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813006.953761:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322626048 00000100:00100000:3.0:1788813006.953768:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322626048 00000100:00100000:3.0:1788813006.953824:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788813006.953831:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07822850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:5831:x1875706322626048:12345-0@lo:101: 00010000:00010000:3.0:1788813006.953841:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813006.953853:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef1164e200/0x1b294f297b1ec088 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec081 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813006.953877:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef1164e200/0x1b294f297b1ec088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec081 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813006.953888:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef1164e200/0x1b294f297b1ec088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec081 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813006.953896:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164e200, rc 0) 00000100:00100000:3.0:1788813006.953929:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07822850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:5831:x1875706322626048:12345-0@lo:101: Request processed in 98us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813006.953934:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788813006.954132:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322626048:0@lo:101: 00010000:00010000:1.0:1788813006.954145:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef4214c200/0x1b294f297b1ec081 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec088 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813006.954154:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef4214c200/0x1b294f297b1ec081 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec088 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813006.954209:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322626176:0@lo:501: 00000100:00100000:1.0:1788813006.954236:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813006.954254:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef126220c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813006.954267:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322626176 00000100:00100000:1.0:1788813006.954271:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322626176 00000100:00100000:1.0:1788813006.954290:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788813006.954295:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:5831:x1875706322626176:12345-0@lo:501: 00000100:00100000:1.0:1788813006.954652:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:5831:x1875706322626176:12345-0@lo:501: Request processed in 356us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813006.954659:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788813006.954693:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322626176:0@lo:501: 00000100:00100000:1.0:1788813006.954724:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322626304:0@lo:503: 00000100:00100000:1.0:1788813006.954950:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813006.954968:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef126220c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813006.954981:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322626304 00000100:00100000:1.0:1788813006.954985:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322626304 00000100:00100000:1.0:1788813006.955004:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788813006.955009:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:5831:x1875706322626304:12345-0@lo:503: 00000100:00100000:1.0:1788813006.955209:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:5831:x1875706322626304:12345-0@lo:503: Request processed in 199us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813006.955216:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788813006.955252:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322626304:0@lo:503: 00000100:00100000:1.0:1788813006.956187:0:6770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6770:1875706322626432:0@lo:502: 00000100:00100000:1.0:1788813006.956249:0:6770:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813006.956319:0:6770:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef12622840 going to sleep for 11 seconds 00000100:00100000:2.0:1788813006.956439:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322626432 00000100:00100000:2.0:1788813006.956447:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322626432 00000100:00100000:0.0:1788813006.957093:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788813006.957110:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:6770:x1875706322626432:12345-0@lo:502: 00000100:00100000:0.0:1788813006.957704:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:6770:x1875706322626432:12345-0@lo:502: Request processed in 597us (1451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813006.957726:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788813006.959332:0:6770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6770:1875706322626432:0@lo:502: 00000020:01000000:1.0:1788813006.959765:0:6770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788813006.959776:0:6770:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788813006.959806:0:6770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813006.959809:0:6770:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788813006.959824:0:6770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788813006.959828:0:6770:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:1.0:1788813006.959865:0:6770:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788813006.959869:0:6770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788813006.959890:0:6770:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93ef119e3380) 00000020:00000080:1.0:1788813006.959923:0:6770:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788813006.959930:0:6770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788813006.960080:0:6770:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788813006.960089:0:6770:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788813006.960109:0:6770:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b294f297b1ec096 00010000:00080000:1.0:1788813006.960160:0:6770:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93ef19789800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1788813006.960757:0:6770:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788813007.021492:0:6770:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788813007.021527:0:6770:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788813007.022480:0:6770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788813007.024554:0:6770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788813007.024655:0:6770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788813007.025100:0:6770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788813007.027022:0:6775:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788813007.027030:0:6775:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788813007.032847:0:6770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788813007.032869:0:6770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788813007.032920:0:6770:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788813007.032949:0:6770:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b294f297b1ec09d 00000100:00080000:1.0:1788813007.032964:0:6770:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788813007.032979:0:6770:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93ef19789800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1788813007.033038:0:6770:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ef20e4d180 x1875706322626560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813007.033058:0:6770:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788813007.033127:0:6770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813007.033132:0:6770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813007.033135:0:6770:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788813007.033138:0:6770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813007.033143:0:6770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813007.033145:0:6770:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788813007.033150:0:6770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000100:00100000:0.0:1788813007.033150:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1875706322626560:0@lo:8: 00000020:00000080:1.0:1788813007.033154:0:6770:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788813007.033191:0:6770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6770:1875706322626688:0@lo:502: 00000100:00100000:0.0:1788813007.033253:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813007.033261:0:6770:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813007.033422:0:6770:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a109240 going to sleep for 11 seconds 00000100:00100000:1.0:1788813007.033518:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322626560 00000100:00100000:1.0:1788813007.033527:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322626560 00000100:00100000:1.0:1788813007.033561:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813007.033569:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3298:x1875706322626560:12345-0@lo:8: 00010000:00080000:1.0:1788813007.033604:0:6675:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:1.0:1788813007.033632:0:6675:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b294f297b1ec0a4 00002000:00100000:1.0:1788813007.033671:0:6675:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93ef12165800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788813007.033676:0:6675:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1788813007.033680:0:6675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788813007.033975:0:6675:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788813007.034141:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322626816:0@lo:400: 00000100:00100000:0.0:1788813007.034189:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813007.034219:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813007.034226:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322626944:0@lo:400: 00000100:00100000:0.0:1788813007.034249:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813007.034297:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322626816 00000100:00100000:0.0:1788813007.034302:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322626816 00000100:00100000:0.0:1788813007.034348:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322626944 00000100:00100000:0.0:1788813007.034352:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322626944 00000100:00100000:0.0:1788813007.034384:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788813007.034392:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322626816:12345-0@lo:400: 00000100:00100000:0.0:1788813007.034449:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322626816:12345-0@lo:400: Request processed in 58us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813007.034457:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788813007.034475:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788813007.034482:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322626944:12345-0@lo:400: 00000100:00100000:0.0:1788813007.034511:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322626944:12345-0@lo:400: Request processed in 30us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813007.034517:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788813007.034558:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef20e4d500 x1875706322626944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813007.034577:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322626944:0@lo:400: 00010000:00080000:0.0:1788813007.034602:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef20e4f480 x1875706322626816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813007.034620:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322626816:0@lo:400: 00002000:00080000:1.0:1788813007.034904:0:6675:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788813007.034937:0:6675:0:(import.c:65:import_set_state_nolock()) ffff93ef12166000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813007.034988:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1875706322626560:12345-0@lo:8: Request processed in 1417us (1736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813007.035073:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813007.035103:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322626688 00000100:00100000:1.0:1788813007.035108:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322626688 00000100:00100000:1.0:1788813007.035142:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1788813007.035152:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef20e4d180 x1875706322626560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788813017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813007.035153:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:6770:x1875706322626688:12345-0@lo:502: 00000100:00100000:0.0:1788813007.035168:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788813007.035176:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788813007.035185:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788813007.035191:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788813007.035194:0:3298:0:(import.c:65:import_set_state_nolock()) ffff93ef19789800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788813007.035206:0:3298:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788813007.035211:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1875706322626560:0@lo:8: 00000100:00100000:1.0:1788813007.035428:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:6770:x1875706322626688:12345-0@lo:502: Request processed in 278us (2168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813007.035436:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788813007.035840:0:6770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:6770:1875706322626688:0@lo:502: 00000020:01000000:0.0:1788813007.035876:0:6770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813007.035884:0:6770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813007.035886:0:6770:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788813007.035893:0:6770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00080000:2.0:1788813007.038238:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:1.0:1788813007.038327:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788813007.038366:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788813007.038382:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214c200/0x1b294f297b1ec081 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec088 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813007.038412:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef4214c200/0x1b294f297b1ec081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec088 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813007.038425:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788813007.038429:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93ef2a35b380 from 1 10000000:01000000:1.0:1788813007.038432:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788813007.038484:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec0ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813007.038494:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec0ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813007.038508:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec0ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813007.038537:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322627072:0@lo:101: 00000100:00100000:1.0:1788813007.039379:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813007.039434:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a109d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813007.039465:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322627072 00000100:00100000:1.0:1788813007.039474:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322627072 00000100:00100000:1.0:1788813007.039533:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788813007.039546:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:5831:x1875706322627072:12345-0@lo:101: 00010000:00010000:1.0:1788813007.039563:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813007.039582:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef4214c000/0x1b294f297b1ec0b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec0ab expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813007.039898:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef4214c000/0x1b294f297b1ec0b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec0ab expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813007.039926:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef4214c000/0x1b294f297b1ec0b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec0ab expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813007.039937:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef4214c000, rc 0) 00000100:00100000:1.0:1788813007.040848:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:5831:x1875706322627072:12345-0@lo:101: Request processed in 1301us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813007.040862:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788813007.040967:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322627072:0@lo:101: 00010000:00010000:1.0:1788813007.041076:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec0ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec0b2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813007.041094:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec0ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec0b2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813007.041192:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322627200:0@lo:501: 00000100:00100000:1.0:1788813007.041244:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813007.041287:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a109d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813007.041312:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322627200 00000100:00100000:1.0:1788813007.041317:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322627200 00000100:00100000:1.0:1788813007.041352:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788813007.041363:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:5831:x1875706322627200:12345-0@lo:501: 00000100:00100000:1.0:1788813007.041657:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:5831:x1875706322627200:12345-0@lo:501: Request processed in 295us (412us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788813007.041665:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000004:00080000:0.0:1788813007.041954:0:6775:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788813007.042364:0:6775:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 167428581582ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788813007.042658:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322627200:0@lo:501: 10000000:01000000:1.0:1788813007.042857:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788813007.042881:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec0ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec0b2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813007.042892:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec0ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec0b2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813007.097494:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322627328:0@lo:13: 00000100:00100000:1.0:1788813007.097607:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813007.101438:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322627328 00000100:00100000:1.0:1788813007.101456:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322627328 00000100:00100000:1.0:1788813007.102045:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813007.102059:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875706322627328:12345-0@lo:13: 00002000:00000024:1.0:1788813007.102090:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:1.0:1788813007.102187:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875706322627328:12345-0@lo:13: Request processed in 132us (4581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813007.102194:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788813007.102220:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788813007.102286:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef35a1c380 x1875706322627328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813007.102312:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322627328:0@lo:13: 00000004:00080000:0.0:1788813007.102340:0:6776:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788813007.102389:0:6776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6776:1875706322627456:0@lo:7: 00000100:00100000:0.0:1788813007.102498:0:6776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813007.102536:0:6776:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef10a23480 going to sleep for 11 seconds 00000100:00100000:1.0:1788813007.103174:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322627456 00000100:00100000:1.0:1788813007.103183:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322627456 00000100:00100000:1.0:1788813007.103221:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813007.103294:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6776:x1875706322627456:12345-0@lo:7: 00002000:00080000:1.0:1788813007.124854:0:6677:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788813007.124862:0:6677:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788813007.124971:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6776:x1875706322627456:12345-0@lo:7: Request processed in 21736us (22468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813007.124996:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788813007.125076:0:6776:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef35a1e680 x1875706322627456/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788813023 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813007.125092:0:6776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6776:1875706322627456:0@lo:7: 00000004:00080000:1.0:1788813007.125121:0:6776:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788813007.125170:0:6776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6776:1875706322627584:0@lo:5: 00000100:00100000:1.0:1788813007.125227:0:6776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813007.125278:0:6776:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a109480 going to sleep for 11 seconds 00000100:00100000:1.0:1788813007.125297:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322627584 00000100:00100000:1.0:1788813007.125302:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322627584 00000100:00100000:1.0:1788813007.125730:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813007.125740:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6776:x1875706322627584:12345-0@lo:5: 00002000:00080000:1.0:1788813007.125767:0:6675:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788813007.125771:0:6675:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788813007.126046:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6776:x1875706322627584:12345-0@lo:5: Request processed in 307us (822us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788813007.126053:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788813007.126082:0:6776:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef20e4ca80 x1875706322627584/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788813023 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813007.126095:0:6776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6776:1875706322627584:0@lo:5: 00000004:00080000:1.0:1788813007.126104:0:6776:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788813007.126130:0:6776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6776:1875706322627712:0@lo:700: 00000100:00100000:1.0:1788813007.126155:0:6776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813007.126174:0:6776:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a109480 going to sleep for 11 seconds 00000100:00100000:1.0:1788813007.126263:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322627712 00000100:00100000:1.0:1788813007.126276:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322627712 00000100:00100000:1.0:1788813007.126303:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813007.126309:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6776:x1875706322627712:12345-0@lo:700: 00000100:00100000:1.0:1788813007.126336:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6684:1875706322627840:0@lo:700: 00000100:00100000:1.0:1788813007.126488:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813007.126510:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a109540 going to sleep for 11 seconds 00000100:00100000:1.0:1788813007.126536:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322627840 00000100:00100000:1.0:1788813007.126540:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322627840 00000100:00100000:1.0:1788813007.126726:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813007.126734:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6684:x1875706322627840:12345-0@lo:700: 00000004:00080000:2.0:1788813007.133889:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:0.0:1788813007.163304:0:5841:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1788813007.172965:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6684:x1875706322627840:12345-0@lo:700: Request processed in 46217us (46460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813007.172985:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788813007.174030:0:6684:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef20e4c380 x1875706322627840/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788813023 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813007.174053:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6684:1875706322627840:0@lo:700: 40000000:02000000:3.0:1788813007.174072:0:6684:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:3.0:1788813007.299958:0:6700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788813007.299990:0:6700:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788813007.300092:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6776:x1875706322627712:12345-0@lo:700: Request processed in 173772us (173925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813007.300116:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788813007.300166:0:6776:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef20e4f800 x1875706322627712/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788813023 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813007.300196:0:6776:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788813007.300214:0:6776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6776:1875706322627712:0@lo:700: 00000004:02000040:2.0:1788813007.328060:0:6776:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1788813007.335743:0:6776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6776:1875706322627968:0@lo:5: 00000100:00100000:3.0:1788813007.336368:0:6776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813007.336429:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322627968 00000100:00100000:3.0:1788813007.336438:0:6776:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1144c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788813007.336445:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322627968 00000100:00100000:1.0:1788813007.336516:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813007.336527:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6776:x1875706322627968:12345-0@lo:5: 00002000:00080000:2.0:1788813007.344187:0:6675:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788813007.344259:0:6675:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1788813007.350147:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6776:x1875706322627968:12345-0@lo:5: Request processed in 13612us (13771us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788813007.350168:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788813007.350631:0:6776:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef35f2dc00 x1875706322627968/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788813023 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813007.350652:0:6776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6776:1875706322627968:0@lo:5: 00000004:00080000:0.0:1788813007.350684:0:6776:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1788813007.965930:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813008.988940:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813010.012917:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788813010.717763:0:7041:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788813011.037632:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813012.061248:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813012.125818:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322628224:0@lo:400: 00000100:00100000:3.0:1788813012.125866:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322628096:0@lo:400: 00000100:00100000:0.0:1788813012.125900:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813012.126415:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813012.126481:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322628608:0@lo:13: 00000100:00100000:3.0:1788813012.126513:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813012.126549:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788813012.126566:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322628480:0@lo:400: 00000100:00100000:3.0:1788813012.126593:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813012.126629:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1875706322628352:0@lo:400: 00000100:00100000:3.0:1788813012.126654:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813012.126688:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322628096 00000100:00100000:3.0:1788813012.126698:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322628096 00000100:00100000:0.0:1788813012.126713:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322628224 00000100:00100000:0.0:1788813012.126720:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322628224 00000100:00100000:3.0:1788813012.126752:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788813012.126760:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322628352 00000100:00100000:0.0:1788813012.126764:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322628352 00000100:00100000:3.0:1788813012.126768:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21385050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:3302:x1875706322628096:12345-0@lo:400: 00000100:00100000:0.0:1788813012.126815:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788813012.126824:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322628224:12345-0@lo:400: 00000100:00100000:2.0:1788813012.126830:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322628608 00000100:00100000:2.0:1788813012.126836:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322628608 00000100:00100000:3.0:1788813012.126852:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21385050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:3302:x1875706322628096:12345-0@lo:400: Request processed in 89us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813012.126860:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788813012.126880:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322628224:12345-0@lo:400: Request processed in 57us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813012.126885:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788813012.126891:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788813012.126896:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875706322628608:12345-0@lo:13: 00000100:00100000:3.0:1788813012.126906:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322628480 00000100:00100000:3.0:1788813012.126910:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322628480 00000100:00100000:0.0:1788813012.126914:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788813012.126924:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875706322628352:12345-0@lo:400: 00002000:00000024:2.0:1788813012.126934:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813012.126941:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813012.126967:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875706322628352:12345-0@lo:400: Request processed in 45us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813012.126971:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3302:x1875706322628480:12345-0@lo:400: 00000100:00100000:0.0:1788813012.126976:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788813012.126984:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1875706322628608:12345-0@lo:13: Request processed in 90us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813012.126992:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788813012.127009:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813012.127014:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1875706322628480:12345-0@lo:400: Request processed in 59us (419us total) trans 0 rc 0/0 00000100:00080000:0.0:1788813012.127017:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813012.127024:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788813012.127067:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef35f2f480 x1875706322628480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788813012.127067:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef35f2c000 x1875706322628352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813012.127101:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1875706322628352:0@lo:400: 00000100:00100000:3.0:1788813012.127102:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322628480:0@lo:400: 00000100:00100000:3.0:1788813012.127123:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322628096:0@lo:400: 00010000:00080000:3.0:1788813012.127136:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef35a1fb80 x1875706322628608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813012.127152:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322628608:0@lo:13: 00010000:00080000:0.0:1788813012.127155:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef35f2d500 x1875706322628224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813012.127166:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322628224:0@lo:400: 00000001:00080000:1.0:1788813012.717893:0:6700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1788813013.085103:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813014.110737:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813015.133555:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813016.157622:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813017.182449:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813017.245322:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322628992:0@lo:400: 00000100:00100000:3.0:1788813017.245389:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813017.245439:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813017.245445:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322629120:0@lo:400: 00000100:00100000:3.0:1788813017.245469:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813017.245868:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322629120 00000100:00100000:2.0:1788813017.245876:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322629120 00000100:00100000:2.0:1788813017.245940:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813017.245950:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322629120:12345-0@lo:400: 00000100:00100000:2.0:1788813017.246008:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322629120:12345-0@lo:400: Request processed in 60us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813017.246015:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788813017.246039:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788813017.246079:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef35f2f800 x1875706322629120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813017.246463:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788813017.246478:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322629120:0@lo:400: 00000100:00100000:0.0:1788813017.248041:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322628736:0@lo:400: 00000100:00100000:0.0:1788813017.248118:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813017.248165:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322629248:0@lo:13: 00000100:00100000:0.0:1788813017.248201:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813017.248232:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813017.248239:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322628864:0@lo:400: 00000100:00100000:0.0:1788813017.248270:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813017.248310:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322628992 00000100:00100000:0.0:1788813017.248321:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322628992 00000100:00100000:0.0:1788813017.248502:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322628864 00000100:00100000:0.0:1788813017.248507:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322628864 00000100:00100000:0.0:1788813017.248540:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788813017.248551:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322628992:12345-0@lo:400: 00000100:00100000:0.0:1788813017.248623:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322628992:12345-0@lo:400: Request processed in 72us (3229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813017.248630:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788813017.248649:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788813017.248655:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322628864:12345-0@lo:400: 00000100:00100000:0.0:1788813017.248692:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322628864:12345-0@lo:400: Request processed in 38us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813017.248699:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788813017.248958:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322628736 00000100:00100000:2.0:1788813017.248964:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322628736 00000100:00100000:2.0:1788813017.248994:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788813017.248999:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:3299:x1875706322628736:12345-0@lo:400: 00000100:00100000:2.0:1788813017.249033:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:3299:x1875706322628736:12345-0@lo:400: Request processed in 34us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813017.249038:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788813017.249080:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322629248 00000100:00100000:2.0:1788813017.249084:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322629248 00000100:00100000:2.0:1788813017.249118:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788813017.249124:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322629248:12345-0@lo:13: 00002000:00000024:2.0:1788813017.249156:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813017.249196:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322629248:12345-0@lo:13: Request processed in 73us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813017.249202:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788813017.249224:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788813017.249565:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef35f2f480 x1875706322628864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813017.249583:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322628864:0@lo:400: 00000100:00100000:0.0:1788813017.249593:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322628736:0@lo:400: 00010000:00080000:0.0:1788813017.249610:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef35a1d880 x1875706322629248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788813017.249654:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef35f2f100 x1875706322628992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813017.249664:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322628992:0@lo:400: 00000100:00100000:0.0:1788813017.250139:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322629248:0@lo:13: 00010000:00010000:1.0:1788813018.204949:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813019.233304:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788813019.488763:0:7615:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788813019.488768:0:7615:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788813019.488943:0:7615:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93ee0532b000 00000020:01000004:1.0:1788813019.488978:0:7615:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788813019.488990:0:7615:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788813019.489004:0:7615:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93ef119e4d40) 00000020:00000080:1.0:1788813019.489021:0:7615:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788813019.501394:0:7615:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788813019.501647:0:7615:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788813019.518702:0:7615:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788813019.523293:0:7615:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788813019.523330:0:7615:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788813019.523388:0:7615:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788813019.523415:0:7615:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788813019.523761:0:7615:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788813019.523772:0:7615:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788813019.523878:0:7615:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1b294f297b1ec0c0 00000020:01000004:2.0:1788813019.523887:0:7615:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788813019.523908:0:7615:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788813019.523911:0:7615:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788813019.523917:0:7615:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788813019.523937:0:7615:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788813019.523941:0:7615:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788813019.540677:0:7615:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788813019.540716:0:7615:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.113@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788813019.540721:0:7615:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788813019.540726:0:7615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788813019.540728:0:7615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813019.540729:0:7615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813019.540730:0:7615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813019.540731:0:7615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813019.540732:0:7615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813019.540733:0:7615:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788813019.540735:0:7615:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788813019.540736:0:7615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813019.540737:0:7615:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788813019.540740:0:7615:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788813019.540742:0:7615:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788813019.540744:0:7615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788813019.540745:0:7615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813019.540746:0:7615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813019.540747:0:7615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813019.540748:0:7615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813019.540749:0:7615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813019.540750:0:7615:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788813019.540751:0:7615:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788813019.540752:0:7615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813019.540753:0:7615:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788813019.540778:0:7615:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788813019.540819:0:7615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322629376:0@lo:253: 00000100:00100000:2.0:1788813019.540882:0:7615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813019.540995:0:7615:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef18d56a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813019.541127:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322629376 00000100:00100000:0.0:1788813019.541136:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322629376 00000100:00100000:0.0:1788813019.541216:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788813019.541226:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21387050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:7615:x1875706322629376:12345-0@lo:253: 20000000:01000000:0.0:1788813019.541256:0:5827:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788813019.541261:0:5827:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788813019.541266:0:5827:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788813019.541270:0:5827:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788813019.542301:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813019.542554:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788813019.542568:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788813019.542608:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788813019.542616:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788813019.542644:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788813019.542690:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788813019.543173:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788813019.543193:0:5827:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:0.0:1788813019.543195:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:0.0:1788813019.543230:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788813019.543238:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788813019.543290:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788813019.543298:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:0.0:1788813019.543331:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788813019.543341:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788813019.543372:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788813019.543422:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788813019.544362:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788813019.544385:0:5827:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:0.0:1788813019.544387:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:0.0:1788813019.544420:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788813019.544427:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788813019.544451:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788813019.544457:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:0.0:1788813019.545094:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788813019.545107:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788813019.545179:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788813019.545214:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788813019.545230:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788813019.545233:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788813019.545238:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788813019.545240:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788813019.545242:0:5827:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788813019.545254:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788813019.545256:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788813019.545288:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788813019.545290:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788813019.545936:0:7618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788813019.546069:0:7618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788813019.546097:0:7618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788813019.546372:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788813019.546406:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788813019.546469:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1788813019.546480:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788813019.546482:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788813019.546969:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1788813019.547009:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1788813019.547052:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788813019.547288:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788813019.547320:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788813019.547367:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788813019.547377:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788813019.547379:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788813019.547710:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788813019.547920:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788813019.547968:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788813019.548020:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788813019.548031:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788813019.548040:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788813019.548491:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1788813019.548549:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1788813019.548600:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788813019.548832:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1788813019.548872:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1788813019.548905:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:0.0:1788813019.548921:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788813019.548940:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ef00030000/0x1b294f297b1ec0c7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.549064:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef21618600/0x1b294f297b1ec018 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec011 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.549073:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef1164e800/0x1b294f297b1ec042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec03b expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.549081:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef00030e00/0x1b294f297b1ec06c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec065 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.549089:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef1164e200/0x1b294f297b1ec088 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec081 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.549097:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef4214c000/0x1b294f297b1ec0b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec0ab expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.549104:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ef00030000/0x1b294f297b1ec0c7 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.549141:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef4214c000/0x1b294f297b1ec0b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ec0ab expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.549155:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ef4214c000/0x1b294f297b1ec0b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ec0ab expref: 16 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813019.549169:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1875706322629504:0@lo:104: 00000100:00100000:0.0:1788813019.549239:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788813019.549286:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef1164e200/0x1b294f297b1ec088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ec081 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.549295:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ef1164e200/0x1b294f297b1ec088 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ec081 expref: 16 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813019.549304:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1875706322629632:0@lo:104: 00010000:00010000:0.0:1788813019.549337:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef00030e00/0x1b294f297b1ec06c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ec065 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.549346:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ef00030e00/0x1b294f297b1ec06c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ec065 expref: 16 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813019.549354:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1875706322629760:0@lo:104: 00010000:00010000:0.0:1788813019.549378:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef1164e800/0x1b294f297b1ec042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ec03b expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.549386:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ef1164e800/0x1b294f297b1ec042 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ec03b expref: 16 pid: 5828 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813019.549394:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1875706322629888:0@lo:104: 00010000:00010000:0.0:1788813019.549413:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef21618600/0x1b294f297b1ec018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ec011 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.549421:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ef21618600/0x1b294f297b1ec018 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ec011 expref: 16 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813019.549428:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1875706322630016:0@lo:104: 00000100:00100000:0.0:1788813019.549452:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1219f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813019.549547:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788813019.549565:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813019.549584:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813019.549591:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813019.549598:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813019.549617:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322629504 00000100:00100000:3.0:1788813019.549623:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322629504 00000100:00100000:3.0:1788813019.549652:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322629632 00000100:00100000:3.0:1788813019.549654:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322629632 00000100:00100000:3.0:1788813019.549662:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322629760 00000100:00100000:3.0:1788813019.549664:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322629760 00000100:00100000:3.0:1788813019.549671:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322629888 00000100:00100000:3.0:1788813019.549673:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322629888 00000100:00100000:3.0:1788813019.549680:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322630016 00000100:00100000:3.0:1788813019.549681:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322630016 00000100:00100000:3.0:1788813019.549693:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788813019.549701:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1211c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+7:5827:x1875706322629504:12345-0@lo:104: 00010000:00010000:3.0:1788813019.549713:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec0ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec0b2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.549775:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788813019.549799:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1211c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+7:5827:x1875706322629504:12345-0@lo:104: Request processed in 81us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813019.549806:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788813019.549840:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788813019.549846:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+6:5827:x1875706322629632:12345-0@lo:104: 00010000:00010000:3.0:1788813019.549853:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef4214c200/0x1b294f297b1ec081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec088 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.549883:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788813019.549888:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+6:5827:x1875706322629632:12345-0@lo:104: Request processed in 43us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813019.549894:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788813019.549905:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788813019.549911:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+5:5827:x1875706322629760:12345-0@lo:104: 00010000:00010000:3.0:1788813019.549923:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef4214d800/0x1b294f297b1ec065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec06c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813019.550080:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1875706322629504:0@lo:104: 00000100:00100000:2.0:1788813019.550089:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1875706322629632:0@lo:104: 00000100:00100000:2.0:1788813019.550096:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1875706322629760:0@lo:104: 00010000:00010000:3.0:1788813019.550131:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788813019.550137:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+5:5827:x1875706322629760:12345-0@lo:104: Request processed in 226us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813019.550144:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788813019.550156:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788813019.550162:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+4:5827:x1875706322629888:12345-0@lo:104: 00010000:00010000:3.0:1788813019.550170:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef1164f600/0x1b294f297b1ec03b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec042 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550207:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788813019.550212:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+4:5827:x1875706322629888:12345-0@lo:104: Request processed in 51us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813019.550217:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788813019.550227:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788813019.550233:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:5827:x1875706322630016:12345-0@lo:104: 00010000:00010000:3.0:1788813019.550240:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef4214de00/0x1b294f297b1ec011 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec018 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550262:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788813019.550266:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:5827:x1875706322630016:12345-0@lo:104: Request processed in 34us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813019.550272:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788813019.550285:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788813019.550290:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec0ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec0b2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550303:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214d200 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:3.0:1788813019.550307:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec0ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ec0b2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550316:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec0ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ec0b2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813019.550324:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec0ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ec0b2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813019.550330:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813019.550357:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec0ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec0b2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550363:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813019.550379:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec0ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec0b2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550386:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec0ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec0b2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550397:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788813019.550401:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef4214c200/0x1b294f297b1ec081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec088 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550407:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214c200 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:3.0:1788813019.550409:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214c200/0x1b294f297b1ec081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ec088 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550425:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef4214c200/0x1b294f297b1ec081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ec088 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813019.550431:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214c200/0x1b294f297b1ec081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ec088 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813019.550436:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813019.550450:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef4214c200/0x1b294f297b1ec081 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec088 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550456:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813019.550469:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef4214c200/0x1b294f297b1ec081 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec088 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550476:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef4214c200/0x1b294f297b1ec081 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec088 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550485:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788813019.550488:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef4214d800/0x1b294f297b1ec065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec06c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550493:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214d800 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:3.0:1788813019.550495:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214d800/0x1b294f297b1ec065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ec06c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550501:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef4214d800/0x1b294f297b1ec065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ec06c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813019.550518:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214d800/0x1b294f297b1ec065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ec06c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813019.550529:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813019.550543:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef4214d800/0x1b294f297b1ec065 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec06c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550549:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813019.550555:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef4214d800/0x1b294f297b1ec065 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec06c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550562:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef4214d800/0x1b294f297b1ec065 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec06c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550571:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788813019.550573:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef1164f600/0x1b294f297b1ec03b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec042 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550579:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f600 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:3.0:1788813019.550582:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef1164f600/0x1b294f297b1ec03b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ec042 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550589:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef1164f600/0x1b294f297b1ec03b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ec042 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813019.550595:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef1164f600/0x1b294f297b1ec03b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ec042 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813019.550601:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813019.550609:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef1164f600/0x1b294f297b1ec03b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec042 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550615:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813019.550625:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef1164f600/0x1b294f297b1ec03b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec042 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550632:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef1164f600/0x1b294f297b1ec03b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec042 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550641:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813019.550644:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef4214de00/0x1b294f297b1ec011 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec018 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550650:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214de00 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:3.0:1788813019.550653:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214de00/0x1b294f297b1ec011 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ec018 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550661:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef4214de00/0x1b294f297b1ec011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ec018 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813019.550667:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214de00/0x1b294f297b1ec011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ec018 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813019.550672:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813019.550682:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef4214de00/0x1b294f297b1ec011 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec018 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550687:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813019.550690:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef4214de00/0x1b294f297b1ec011 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec018 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550697:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef4214de00/0x1b294f297b1ec011 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec018 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.550709:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813019.550715:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813019.550717:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813019.550724:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813019.550744:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322630144:0@lo:103: 00000100:00100000:3.0:1788813019.550775:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813019.550828:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322630656:0@lo:103: 00000100:00100000:3.0:1788813019.550847:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813019.550866:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813019.550872:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322630528:0@lo:103: 00000100:00100000:3.0:1788813019.550903:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813019.550934:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322630272:0@lo:103: 00000100:00100000:2.0:1788813019.551067:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1875706322629888:0@lo:104: 00000100:00100000:2.0:1788813019.551076:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1875706322630016:0@lo:104: 00010000:00010000:2.0:1788813019.551102:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ef00030000/0x1b294f297b1ec0c7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813019.551199:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813019.551218:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813019.551224:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322630400:0@lo:103: 00000100:00100000:3.0:1788813019.551243:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813019.551268:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322630144 00000100:00100000:3.0:1788813019.551273:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322630144 00010000:00010000:3.0:1788813019.551295:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef4214c000/0x1b294f297b1ec0b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec0ab expref: 17 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813019.551311:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322630656 00000100:00100000:3.0:1788813019.551314:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322630656 00010000:00010000:3.0:1788813019.551324:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef21618600/0x1b294f297b1ec018 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec011 expref: 18 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813019.551334:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322630528 00000100:00100000:3.0:1788813019.551336:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322630528 00010000:00010000:3.0:1788813019.551345:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef1164e800/0x1b294f297b1ec042 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec03b expref: 19 pid: 5828 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813019.551368:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322630272 00000100:00100000:3.0:1788813019.551372:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322630272 00010000:00010000:3.0:1788813019.551383:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef1164e200/0x1b294f297b1ec088 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec081 expref: 20 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813019.551392:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322630400 00000100:00100000:3.0:1788813019.551394:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322630400 00010000:00010000:3.0:1788813019.551402:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef00030e00/0x1b294f297b1ec06c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec065 expref: 21 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813019.551414:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788813019.551420:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+21:3300:x1875706322630144:12345-0@lo:103: 00010000:00010000:3.0:1788813019.551431:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813019.551435:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef4214c000/0x1b294f297b1ec0b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec0ab expref: 21 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.551445:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef4214c000/0x1b294f297b1ec0b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ec0ab expref: 21 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.551458:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef4214c000/0x1b294f297b1ec0b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ec0ab expref: 21 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.551471:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813019.551555:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+20:3300:x1875706322630144:12345-0@lo:103: Request processed in 134us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813019.551561:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788813019.551575:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788813019.551581:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3300:x1875706322630656:12345-0@lo:103: 00010000:00010000:3.0:1788813019.551597:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813019.551602:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef21618600/0x1b294f297b1ec018 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec011 expref: 19 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.551611:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef21618600/0x1b294f297b1ec018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ec011 expref: 19 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.551620:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef21618600/0x1b294f297b1ec018 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ec011 expref: 19 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.551628:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813019.551649:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:3300:x1875706322630656:12345-0@lo:103: Request processed in 69us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813019.551655:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788813019.551666:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788813019.551672:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:3300:x1875706322630528:12345-0@lo:103: 00010000:00010000:3.0:1788813019.551679:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813019.551683:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef1164e800/0x1b294f297b1ec042 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec03b expref: 17 pid: 5828 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.551690:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef1164e800/0x1b294f297b1ec042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ec03b expref: 17 pid: 5828 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.551700:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef1164e800/0x1b294f297b1ec042 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ec03b expref: 17 pid: 5828 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.551708:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813019.551726:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:3300:x1875706322630528:12345-0@lo:103: Request processed in 55us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813019.551731:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788813019.551750:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788813019.551755:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:3301:x1875706322630272:12345-0@lo:103: 00010000:00010000:3.0:1788813019.551763:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813019.551767:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef1164e200/0x1b294f297b1ec088 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec081 expref: 15 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.551775:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef1164e200/0x1b294f297b1ec088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ec081 expref: 15 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.551817:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef1164e200/0x1b294f297b1ec088 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ec081 expref: 15 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.551827:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813019.551856:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:3301:x1875706322630272:12345-0@lo:103: Request processed in 100us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813019.551862:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788813019.551873:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788813019.551879:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:3301:x1875706322630400:12345-0@lo:103: 00010000:00010000:3.0:1788813019.551896:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813019.551901:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef00030e00/0x1b294f297b1ec06c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec065 expref: 13 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.551910:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef00030e00/0x1b294f297b1ec06c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ec065 expref: 13 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.551919:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef00030e00/0x1b294f297b1ec06c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ec065 expref: 13 pid: 5827 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.551931:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ef00030000/0x1b294f297b1ec0c7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.552017:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef00030000/0x1b294f297b1ec0c7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.552033:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ef00030000/0x1b294f297b1ec0c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.552041:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ef00030000/0x1b294f297b1ec0c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.552049:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ef00030000/0x1b294f297b1ec0c7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.552056:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ef00030000/0x1b294f297b1ec0c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.552062:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef00030000 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813019.552066:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ef00030000/0x1b294f297b1ec0c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.552072:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ef00030000/0x1b294f297b1ec0c7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.552084:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ef00030000/0x1b294f297b1ec0c7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.552094:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813019.552117:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:3301:x1875706322630400:12345-0@lo:103: Request processed in 238us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813019.552124:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788813019.552212:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322630400:0@lo:103: 00000100:00100000:2.0:1788813019.552220:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322630272:0@lo:103: 00010000:00010000:2.0:1788813019.552239:0:5827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ef00030000/0x1b294f297b1ec0c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813019.552247:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ef00030000/0x1b294f297b1ec0c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813019.552253:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef00030000/0x1b294f297b1ec0c7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788813019.552264:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788813019.552491:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322630144:0@lo:103: 00000100:00100000:0.0:1788813019.552500:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322630656:0@lo:103: 00000100:00100000:0.0:1788813019.552525:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322630528:0@lo:103: 00000100:00100000:1.0:1788813019.584723:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21387050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:7615:x1875706322629376:12345-0@lo:253: Request processed in 43491us (43833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813019.584737:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788813019.584852:0:7615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322629376:0@lo:253: 10000000:01000000:2.0:1788813019.584866:0:7615:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788813019.584870:0:7615:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788813019.584871:0:7615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788813019.584873:0:7615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813019.584875:0:7615:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788813019.584876:0:7615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813019.584877:0:7615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813019.584878:0:7615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813019.584880:0:7615:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788813019.584882:0:7615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813019.584883:0:7615:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788813019.584904:0:7615:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93ee0532b000 from lustre-OST0001 10000000:01000000:2.0:1788813019.584935:0:7615:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788813019.584938:0:7615:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788813019.584943:0:7615:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93ef2a35b380 local copy 10000000:01000000:2.0:1788813019.584946:0:7615:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788813019.584979:0:7615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef21618200/0x1b294f297b1ec0ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813019.584991:0:7615:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.113@tcp lock: ffff93ef21618200/0x1b294f297b1ec0ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813019.585000:0:7615:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef21618200/0x1b294f297b1ec0ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813019.585019:0:7615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322630784:0@lo:101: 00000100:00100000:2.0:1788813019.585056:0:7615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813019.585108:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322630784 00000100:00100000:2.0:1788813019.585116:0:7615:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef11fb1480 going to sleep for 11 seconds 00000100:00100000:3.0:1788813019.585120:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322630784 00000100:00100000:3.0:1788813019.585155:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788813019.585164:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21387450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+11:7615:x1875706322630784:12345-0@lo:101: 00010000:00010000:3.0:1788813019.585175:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813019.585187:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef1164e200/0x1b294f297b1ec0d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec0ce expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.585208:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef1164e200/0x1b294f297b1ec0d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec0ce expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.585219:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef1164e200/0x1b294f297b1ec0d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec0ce expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.585228:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164e200, rc 0) 00000100:00100000:3.0:1788813019.585257:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21387450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:7615:x1875706322630784:12345-0@lo:101: Request processed in 95us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813019.585263:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788813019.585273:0:7615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322630784:0@lo:101: 00010000:00010000:2.0:1788813019.585285:0:7615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef21618200/0x1b294f297b1ec0ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1b294f297b1ec0d5 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813019.585294:0:7615:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef21618200/0x1b294f297b1ec0ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1b294f297b1ec0d5 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813019.585478:0:7615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322630912:0@lo:501: 00000100:00100000:2.0:1788813019.585515:0:7615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813019.585536:0:7615:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef11fb1480 going to sleep for 11 seconds 00000100:00100000:1.0:1788813019.585574:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322630912 00000100:00100000:1.0:1788813019.585579:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322630912 00000100:00100000:1.0:1788813019.585609:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788813019.585615:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:7615:x1875706322630912:12345-0@lo:501: 00000100:00100000:2.0:1788813019.585842:0:7615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322630912:0@lo:501: 10000000:01000000:2.0:1788813019.585858:0:7615:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:1.0:1788813019.585898:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:7615:x1875706322630912:12345-0@lo:501: Request processed in 282us (381us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788813019.585905:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 10000000:01000000:3.0:1788813019.585988:0:7615:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788813019.585994:0:7615:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef21618200/0x1b294f297b1ec0ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1b294f297b1ec0d5 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.586002:0:7615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef21618200/0x1b294f297b1ec0ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1b294f297b1ec0d5 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.586010:0:7615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff93ef21618200/0x1b294f297b1ec0ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1b294f297b1ec0d5 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.586032:0:7615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788813019.586051:0:7615:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93ee0532b000 10000000:01000000:3.0:1788813019.586055:0:7615:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788813019.586063:0:7615:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788813019.586065:0:7615:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788813019.586068:0:7615:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788813019.586070:0:7615:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788813019.586083:0:7615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164e800/0x1b294f297b1ec0dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.586087:0:7615:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef1164e800/0x1b294f297b1ec0dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.586093:0:7615:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef1164e800/0x1b294f297b1ec0dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813019.586101:0:7615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d50380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322631040:0@lo:101: 00000100:00100000:3.0:1788813019.586123:0:7615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813019.586145:0:7615:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef356030c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813019.586160:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322631040 00000100:00100000:2.0:1788813019.586171:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322631040 00010000:00010000:1.0:1788813019.586198:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813019.586204:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef21618200/0x1b294f297b1ec0ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1b294f297b1ec0d5 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813019.586205:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788813019.586211:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:7615:x1875706322631040:12345-0@lo:101: 00010000:00010000:1.0:1788813019.586211:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618200 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:1.0:1788813019.586215:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef21618200/0x1b294f297b1ec0ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1b294f297b1ec0d5 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813019.586218:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813019.586223:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef21618200/0x1b294f297b1ec0ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x1b294f297b1ec0d5 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813019.586226:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef21618400/0x1b294f297b1ec0e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec0dc expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813019.586232:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef21618200/0x1b294f297b1ec0ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x1b294f297b1ec0d5 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813019.586241:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef21618400/0x1b294f297b1ec0e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec0dc expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813019.586248:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef21618400/0x1b294f297b1ec0e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec0dc expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813019.586255:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21618400, rc 0) 10000000:01000000:1.0:1788813019.586257:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788813019.586274:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef21618200/0x1b294f297b1ec0ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1b294f297b1ec0d5 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813019.586281:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788813019.586290:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:7615:x1875706322631040:12345-0@lo:101: Request processed in 79us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813019.586296:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00010000:1.0:1788813019.586297:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef21618200/0x1b294f297b1ec0ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1b294f297b1ec0d5 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813019.586304:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef21618200/0x1b294f297b1ec0ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1b294f297b1ec0d5 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813019.586315:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813019.586317:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813019.586318:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813019.586327:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322631168:0@lo:103: 00000100:00100000:1.0:1788813019.586351:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813019.586440:0:7615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d50380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322631040:0@lo:101: 00010000:00010000:0.0:1788813019.586452:0:7615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef1164e800/0x1b294f297b1ec0dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec0e3 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.586460:0:7615:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef1164e800/0x1b294f297b1ec0dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec0e3 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813019.586547:0:7615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322631296:0@lo:501: 00000100:00100000:0.0:1788813019.586576:0:7615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813019.586617:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322631168 00000100:00100000:2.0:1788813019.586621:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322631168 00000100:00100000:2.0:1788813019.586660:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813019.586668:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:3301:x1875706322631168:12345-0@lo:103: 00010000:00010000:2.0:1788813019.586676:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813019.586738:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef1164e200/0x1b294f297b1ec0d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b294f297b1ec0ce expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813019.586748:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813019.586812:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:3301:x1875706322631168:12345-0@lo:103: Request processed in 113us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813019.586818:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813019.586891:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322631168:0@lo:103: 00000100:00100000:3.0:1788813019.587142:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322631296 00000100:00100000:3.0:1788813019.587147:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322631296 00000100:00100000:0.0:1788813019.587159:0:7615:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1219f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813019.587171:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788813019.587178:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:7615:x1875706322631296:12345-0@lo:501: 00000100:00100000:3.0:1788813019.587599:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:7615:x1875706322631296:12345-0@lo:501: Request processed in 420us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813019.587607:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788813019.587689:0:7615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322631296:0@lo:501: 00000100:00100000:0.0:1788813019.587723:0:7615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322631424:0@lo:503: 00000100:00100000:0.0:1788813019.587756:0:7615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813019.587773:0:7615:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1219f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813019.588004:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322631424 00000100:00100000:1.0:1788813019.588009:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322631424 00000100:00100000:1.0:1788813019.588038:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788813019.588045:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:7615:x1875706322631424:12345-0@lo:503: 00000100:00100000:1.0:1788813019.588194:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:7615:x1875706322631424:12345-0@lo:503: Request processed in 150us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813019.588201:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788813019.588279:0:7615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322631424:0@lo:503: 00000040:00080000:0.0:1788813019.588638:0:7615:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788813019.588697:0:7615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322631552:0@lo:502: 00000100:00100000:0.0:1788813019.588735:0:7615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813019.588771:0:7615:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1219f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813019.588911:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322631552 00000100:00100000:3.0:1788813019.588917:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322631552 00000100:00100000:3.0:1788813019.590135:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788813019.590151:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:7615:x1875706322631552:12345-0@lo:502: 00000100:00100000:3.0:1788813019.590413:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:7615:x1875706322631552:12345-0@lo:502: Request processed in 264us (1673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813019.590430:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788813019.590435:0:7615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322631552:0@lo:502: 00000040:00080000:3.0:1788813019.591152:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788813019.591218:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788813019.591255:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788813019.591304:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788813019.591341:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788813019.591375:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788813019.591710:0:7615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322631680:0@lo:502: 00000100:00100000:3.0:1788813019.592197:0:7615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813019.592237:0:7615:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef35603840 going to sleep for 11 seconds 00000100:00100000:1.0:1788813019.592743:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322631680 00000100:00100000:1.0:1788813019.592753:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322631680 00000100:00100000:1.0:1788813019.592836:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788813019.592855:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:7615:x1875706322631680:12345-0@lo:502: 00000100:00100000:1.0:1788813019.593073:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:7615:x1875706322631680:12345-0@lo:502: Request processed in 219us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813019.593080:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788813019.593447:0:7615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322631680:0@lo:502: 00000040:00080000:3.0:1788813019.593599:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788813019.593613:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788813019.594613:0:7622:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788813019.594620:0:7622:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788813019.594625:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813019.594627:0:7622:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788813019.594631:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788813019.594643:0:7622:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93ef119e19c0) 00000020:00000080:1.0:1788813019.594660:0:7622:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788813019.594664:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788813019.594705:0:7622:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93ee0532b000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788813019.594710:0:7622:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788813019.594714:0:7622:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1b294f297b1ec0f1 00010000:00010000:1.0:1788813019.598867:0:7622:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788813019.599210:0:7622:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788813019.602122:0:7622:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788813019.602436:0:7622:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788813019.607657:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788813019.608332:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788813019.609713:0:7622:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788813019.609725:0:7622:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813019.609732:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813019.609734:0:7622:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788813019.609737:0:7622:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813019.609740:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813019.609742:0:7622:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788813019.609744:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788813019.609746:0:7622:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788813019.609852:0:7622:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813019.609861:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813019.609862:0:7622:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788813019.609866:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788813019.610101:0:7615:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788813019.610133:0:7615:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788813019.610154:0:7615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164e800/0x1b294f297b1ec0dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec0e3 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.610166:0:7615:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef1164e800/0x1b294f297b1ec0dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec0e3 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813019.610175:0:7615:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ee0532b000 from 1 10000000:01000000:0.0:1788813019.610178:0:7615:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788813019.610211:0:7615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef00031c00/0x1b294f297b1ec0f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.610220:0:7615:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef00031c00/0x1b294f297b1ec0f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.610230:0:7615:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef00031c00/0x1b294f297b1ec0f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813019.610252:0:7615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322631808:0@lo:101: 00000100:00100000:0.0:1788813019.610320:0:7615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813019.610469:0:7615:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1219f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788813019.610570:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322631808 00000100:00100000:2.0:1788813019.610577:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322631808 00000100:00100000:2.0:1788813019.610629:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788813019.610639:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:7615:x1875706322631808:12345-0@lo:101: 00010000:00010000:2.0:1788813019.610651:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813019.610662:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef21618200/0x1b294f297b1ec0ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec0f8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813019.610684:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef21618200/0x1b294f297b1ec0ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec0f8 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813019.610693:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef21618200/0x1b294f297b1ec0ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec0f8 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813019.610702:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21618200, rc 0) 00000100:00100000:2.0:1788813019.610737:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:7615:x1875706322631808:12345-0@lo:101: Request processed in 100us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813019.610743:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788813019.610905:0:7615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322631808:0@lo:101: 00010000:00010000:0.0:1788813019.610918:0:7615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef00031c00/0x1b294f297b1ec0f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec0ff expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.610927:0:7615:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef00031c00/0x1b294f297b1ec0f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec0ff expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813019.611035:0:7615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322631936:0@lo:501: 00000100:00100000:0.0:1788813019.611062:0:7615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813019.611089:0:7615:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1219f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788813019.611194:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322631936 00000100:00100000:1.0:1788813019.611199:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322631936 00000100:00100000:1.0:1788813019.611221:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788813019.611228:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:7615:x1875706322631936:12345-0@lo:501: 00000100:00100000:1.0:1788813019.611466:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:7615:x1875706322631936:12345-0@lo:501: Request processed in 238us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813019.611474:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788813019.611621:0:7615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322631936:0@lo:501: 00000100:00100000:0.0:1788813019.611650:0:7615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322632064:0@lo:503: 00000100:00100000:0.0:1788813019.611687:0:7615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813019.611709:0:7615:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1219f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788813019.611757:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322632064 00000100:00100000:1.0:1788813019.611761:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322632064 00000100:00100000:1.0:1788813019.611819:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788813019.611826:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:7615:x1875706322632064:12345-0@lo:503: 00000100:00100000:1.0:1788813019.612097:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:7615:x1875706322632064:12345-0@lo:503: Request processed in 271us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813019.612104:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788813019.612247:0:7615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322632064:0@lo:503: 00000040:00080000:0.0:1788813019.612587:0:7615:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788813019.612646:0:7615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322632192:0@lo:502: 00000100:00100000:0.0:1788813019.612683:0:7615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813019.612716:0:7615:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1219f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788813019.612775:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322632192 00000100:00100000:2.0:1788813019.612803:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322632192 00000100:00100000:2.0:1788813019.612833:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788813019.612841:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:7615:x1875706322632192:12345-0@lo:502: 00000100:00100000:2.0:1788813019.613001:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:7615:x1875706322632192:12345-0@lo:502: Request processed in 160us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813019.613007:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788813019.613278:0:7615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322632192:0@lo:502: 00000040:00080000:0.0:1788813019.613620:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788813019.613674:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788813019.613701:0:7615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322632320:0@lo:502: 00000100:00100000:0.0:1788813019.613741:0:7615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813019.613861:0:7615:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1219f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788813019.615202:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322632320 00000100:00100000:2.0:1788813019.615213:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322632320 00000100:00100000:2.0:1788813019.615269:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788813019.615279:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:7615:x1875706322632320:12345-0@lo:502: 00000100:00100000:2.0:1788813019.615548:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:7615:x1875706322632320:12345-0@lo:502: Request processed in 271us (1805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813019.615556:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788813019.615863:0:7615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322632320:0@lo:502: 00000040:00080000:0.0:1788813019.616021:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788813019.616040:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788813019.616616:0:7625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813019.616625:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813019.616627:0:7625:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788813019.616633:0:7625:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93ee0532b000 00000020:00000080:2.0:1788813019.616635:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788813019.616654:0:7625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813019.616657:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813019.616659:0:7625:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788813019.616661:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788813019.617026:0:7615:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788813019.617047:0:7615:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788813019.617718:0:7615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef00031c00/0x1b294f297b1ec0f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec0ff expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.617737:0:7615:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef00031c00/0x1b294f297b1ec0f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec0ff expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813019.617808:0:7615:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788813019.617811:0:7615:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93ee0532b000 10000000:01000000:0.0:1788813019.617814:0:7615:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93ee0532b000 10000000:01000000:0.0:1788813019.617819:0:7615:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788813019.617824:0:7615:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93ee0532b000 from 1 10000000:01000000:0.0:1788813019.617828:0:7615:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788813019.617860:0:7615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec106 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.617868:0:7615:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec106 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.617879:0:7615:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec106 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813019.617900:0:7615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322632448:0@lo:101: 00000100:00100000:0.0:1788813019.617972:0:7615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813019.618014:0:7615:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1219f480 going to sleep for 11 seconds 00000100:00100000:3.0:1788813019.618099:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322632448 00000100:00100000:3.0:1788813019.618106:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322632448 00000100:00100000:3.0:1788813019.618145:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788813019.618153:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:7615:x1875706322632448:12345-0@lo:101: 00010000:00010000:3.0:1788813019.618165:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813019.618178:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef1164f600/0x1b294f297b1ec10d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec106 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.618200:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef1164f600/0x1b294f297b1ec10d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec106 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.618210:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef1164f600/0x1b294f297b1ec10d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec106 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.618219:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164f600, rc 0) 00000100:00100000:3.0:1788813019.618261:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:7615:x1875706322632448:12345-0@lo:101: Request processed in 109us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813019.618268:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788813019.618314:0:7615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322632448:0@lo:101: 00010000:00010000:3.0:1788813019.618327:0:7615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec106 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec10d expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.618335:0:7615:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec106 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec10d expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813019.618414:0:7615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322632576:0@lo:501: 00000100:00100000:3.0:1788813019.618439:0:7615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813019.618460:0:7615:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef36d8c180 going to sleep for 11 seconds 00000100:00100000:2.0:1788813019.618462:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322632576 00000100:00100000:2.0:1788813019.618466:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322632576 00000100:00100000:2.0:1788813019.618496:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788813019.618513:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:7615:x1875706322632576:12345-0@lo:501: 00000100:00100000:2.0:1788813019.618723:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:7615:x1875706322632576:12345-0@lo:501: Request processed in 219us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813019.618729:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788813019.618815:0:7615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322632576:0@lo:501: 00000100:00100000:3.0:1788813019.618841:0:7615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322632704:0@lo:503: 00000100:00100000:3.0:1788813019.618876:0:7615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813019.619115:0:7615:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef36d8c180 going to sleep for 11 seconds 00000100:00100000:0.0:1788813019.619151:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322632704 00000100:00100000:0.0:1788813019.619156:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322632704 00000100:00100000:0.0:1788813019.619217:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788813019.619225:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:7615:x1875706322632704:12345-0@lo:503: 00000100:00100000:0.0:1788813019.619382:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:7615:x1875706322632704:12345-0@lo:503: Request processed in 158us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813019.619389:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788813019.619459:0:7615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322632704:0@lo:503: 00000040:00080000:1.0:1788813019.619716:0:7615:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788813019.619769:0:7615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322632832:0@lo:502: 00000100:00100000:1.0:1788813019.619839:0:7615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813019.620103:0:7615:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1caf36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813019.620144:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322632832 00000100:00100000:3.0:1788813019.620150:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322632832 00000100:00100000:3.0:1788813019.620177:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788813019.620183:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:7615:x1875706322632832:12345-0@lo:502: 00000100:00100000:3.0:1788813019.620408:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:7615:x1875706322632832:12345-0@lo:502: Request processed in 224us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813019.620415:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788813019.621492:0:7615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322632832:0@lo:502: 00000040:00080000:1.0:1788813019.621798:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788813019.621858:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788813019.621892:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788813019.622419:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788813019.622471:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788813019.622546:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788813019.622585:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788813019.622620:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788813019.622669:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788813019.622707:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788813019.622742:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788813019.622833:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788813019.622877:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788813019.622936:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788813019.623491:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788813019.623544:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788813019.623580:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788813019.623623:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788813019.623658:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788813019.623692:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788813019.623741:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788813019.623777:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788813019.623847:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788813019.623905:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788813019.623939:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788813019.624584:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788813019.624643:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788813019.624680:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1788813019.624736:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788813019.625475:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1788813019.625532:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1788813019.625568:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1788813019.625601:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1788813019.625647:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1788813019.625684:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1788813019.625735:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1788813019.625771:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1788813019.626480:0:7615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322632960:0@lo:502: 00000100:00100000:1.0:1788813019.626576:0:7615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813019.626624:0:7615:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1caf36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813019.627056:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322632960 00000100:00100000:3.0:1788813019.627064:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322632960 00000100:00100000:3.0:1788813019.627118:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788813019.627135:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:7615:x1875706322632960:12345-0@lo:502: 00000100:00100000:3.0:1788813019.627533:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:7615:x1875706322632960:12345-0@lo:502: Request processed in 399us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813019.627541:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788813019.627869:0:7615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322632960:0@lo:502: 00000040:00080000:2.0:1788813019.627973:0:7615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1788813019.627987:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788813019.628937:0:7627:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788813019.628953:0:7627:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93ef355ccd40) 00000020:00000080:2.0:1788813019.628974:0:7627:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788813019.629041:0:7627:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93ee0532b000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788813019.629045:0:7627:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93ee0532b000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788813019.629048:0:7627:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ee0532b000 3 00010000:00080000:2.0:1788813019.629071:0:7627:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93ee05212800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1788813019.630866:0:7627:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788813019.631048:0:7627:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788813019.631083:0:7627:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788813019.631094:0:7627:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1b294f297b1ec11b 00000100:00080000:2.0:1788813019.631104:0:7627:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788813019.631113:0:7627:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93ee05212800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788813019.631147:0:7627:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ef3ae78700 x1875706322633088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788813019.631208:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1875706322633088:0@lo:38: 00000100:00100000:0.0:1788813019.631272:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788813019.631337:0:7627:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788813019.632056:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322633088 00000100:00100000:1.0:1788813019.632066:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322633088 00000100:00100000:1.0:1788813019.632106:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813019.632113:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3298:x1875706322633088:12345-0@lo:38: 00010000:00080000:1.0:1788813019.632138:0:5836:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:1.0:1788813019.632169:0:5836:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1b294f297b1ec122 00000004:00100000:1.0:1788813019.632182:0:5836:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788813019.632212:0:5836:0:(import.c:65:import_set_state_nolock()) ffff93ee06e98000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813019.632270:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875706322633088:12345-0@lo:38: Request processed in 157us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813019.632278:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813019.632297:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813019.632306:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322633216:0@lo:400: 00000100:00100000:1.0:1788813019.632333:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813019.632542:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322633216 00000100:00100000:2.0:1788813019.632547:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322633216 00000100:00100000:2.0:1788813019.632583:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788813019.632591:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322633216:12345-0@lo:400: 00000100:00100000:3.0:1788813019.632970:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322633344:0@lo:400: 00000100:00100000:3.0:1788813019.633002:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813019.633019:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813019.633025:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322633472:0@lo:400: 00000100:00100000:3.0:1788813019.633048:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813019.633074:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322633472 00000100:00100000:3.0:1788813019.633078:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322633472 00000100:00100000:3.0:1788813019.633117:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788813019.633125:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322633472:12345-0@lo:400: 00000100:00100000:3.0:1788813019.633161:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322633472:12345-0@lo:400: Request processed in 37us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813019.633167:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788813019.633184:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788813019.633211:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef3ae7ad80 x1875706322633472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813019.633224:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322633472:0@lo:400: 00000100:00100000:0.0:1788813019.634587:0:5834:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788813019.634599:0:5834:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:0.0:1788813019.634715:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef3ae78700 x1875706322633088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813019.634727:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788813019.634737:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788813019.634746:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788813019.634752:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788813019.634755:0:3298:0:(import.c:65:import_set_state_nolock()) ffff93ee05212800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788813019.634762:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1875706322633088:0@lo:38: 00000100:00100000:0.0:1788813019.634865:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322633344 00000100:00100000:0.0:1788813019.634872:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322633344 00000100:00100000:0.0:1788813019.634915:0:5834:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788813019.634924:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788813019.634932:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322633344:12345-0@lo:400: 00000100:00100000:0.0:1788813019.634997:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322633344:12345-0@lo:400: Request processed in 66us (1994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813019.635003:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788813019.636546:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788813019.636589:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef3ae7b800 x1875706322633344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813019.636603:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322633344:0@lo:400: 00000040:00080000:1.0:1788813019.637629:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1788813019.637699:0:7615:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788813019.637725:0:7615:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788813019.637749:0:7615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec106 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec10d expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813019.637759:0:7615:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec10d expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813019.637802:0:7628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d52a00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7628:1875706322633600:0@lo:901: 00000020:01000004:1.0:1788813019.637826:0:7615:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788813019.637828:0:7615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788813019.637829:0:7615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813019.637831:0:7615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788813019.637835:0:7615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813019.637836:0:7615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813019.637838:0:7615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788813019.637839:0:7615:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788813019.637840:0:7615:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788813019.637841:0:7615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813019.637842:0:7615:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788813019.637846:0:7615:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788813019.637847:0:7615:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788813019.637849:0:7615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788813019.637849:0:7615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813019.637850:0:7615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788813019.637851:0:7615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813019.637852:0:7615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813019.637853:0:7615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788813019.637853:0:7615:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788813019.637854:0:7615:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788813019.637855:0:7615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813019.637856:0:7615:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788813019.637868:0:7615:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788813019.637869:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813019.637876:0:7615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322633728:0@lo:253: 00000100:00100000:3.0:1788813019.637907:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322633600 00000100:00100000:1.0:1788813019.637909:0:7615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813019.637913:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322633600 00000100:00100000:1.0:1788813019.637936:0:7615:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1caf3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813019.637953:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788813019.637961:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7628:x1875706322633600:12345-0@lo:901: 00000100:00100000:3.0:1788813019.638296:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7628:x1875706322633600:12345-0@lo:901: Request processed in 334us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813019.638304:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788813019.638322:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813019.641749:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef36d8c0c0 going to sleep for 11 seconds 00010000:00080000:3.0:1788813019.641806:0:7628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ee06d52a00 x1875706322633600/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788813035 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813019.641819:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d52a00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7628:1875706322633600:0@lo:901: 00000100:00100000:2.0:1788813019.643158:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322633216:12345-0@lo:400: Request processed in 10561us (10817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813019.643170:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788813019.644478:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322633728 00000100:00100000:1.0:1788813019.644490:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322633728 00000100:00100000:1.0:1788813019.644558:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788813019.644567:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:7615:x1875706322633728:12345-0@lo:253: 20000000:01000000:1.0:1788813019.644614:0:5828:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788813019.644628:0:5828:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1788813019.645269:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef3ae7b100 x1875706322633216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813019.645285:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322633216:0@lo:400: 20000000:01000000:2.0:1788813019.678576:0:5828:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788813019.678595:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788813019.678657:0:5850:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788813019.678663:0:5850:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788813019.678687:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ef1164e400/0x1b294f297b1ec129 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.678705:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef00031e00/0x1b294f297b1ec07a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec073 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.678715:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ef1164e400/0x1b294f297b1ec129 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.678755:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef00031e00/0x1b294f297b1ec07a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ec073 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.678770:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ef00031e00/0x1b294f297b1ec07a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ec073 expref: 14 pid: 5828 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813019.678833:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d52a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5850:1875706322633856:0@lo:104: 00000100:00100000:3.0:1788813019.678902:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813019.678956:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef36d8cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788813019.678968:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322633856 00000100:00100000:2.0:1788813019.678976:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322633856 00000100:00100000:2.0:1788813019.679035:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788813019.679045:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:5850:x1875706322633856:12345-0@lo:104: 00010000:00010000:2.0:1788813019.679056:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef4214ca00/0x1b294f297b1ec073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec07a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813019.679111:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788813019.679115:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:5850:x1875706322633856:12345-0@lo:104: Request processed in 73us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813019.679128:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788813019.679138:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d52a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5850:1875706322633856:0@lo:104: 00010000:00010000:3.0:1788813019.679159:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ef1164e400/0x1b294f297b1ec129 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.679211:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813019.679217:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef4214ca00/0x1b294f297b1ec073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec07a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.679225:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214ca00 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:0.0:1788813019.679228:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214ca00/0x1b294f297b1ec073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ec07a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.679247:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef4214ca00/0x1b294f297b1ec073 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ec07a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813019.679254:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214ca00/0x1b294f297b1ec073 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ec07a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813019.679259:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788813019.679292:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef4214ca00/0x1b294f297b1ec073 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec07a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.679299:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813019.679327:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef4214ca00/0x1b294f297b1ec073 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec07a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.679334:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef4214ca00/0x1b294f297b1ec073 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec07a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.679357:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813019.679359:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813019.679361:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813019.679395:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788813019.679407:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322633984:0@lo:103: 00000100:00100000:3.0:1788813019.679439:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813019.679569:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322633984 00000100:00100000:0.0:1788813019.679574:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322633984 00010000:00010000:0.0:1788813019.679594:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef00031e00/0x1b294f297b1ec07a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec073 expref: 15 pid: 5828 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813019.679623:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788813019.679629:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07820c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:3302:x1875706322633984:12345-0@lo:103: 00010000:00010000:0.0:1788813019.679640:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813019.679646:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef00031e00/0x1b294f297b1ec07a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec073 expref: 15 pid: 5828 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.679661:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef00031e00/0x1b294f297b1ec07a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ec073 expref: 15 pid: 5828 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.679674:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef00031e00/0x1b294f297b1ec07a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ec073 expref: 15 pid: 5828 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.679686:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ef1164e400/0x1b294f297b1ec129 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.679692:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef1164e400/0x1b294f297b1ec129 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788813019.679705:0:5820:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009102214s 00010000:00010000:0.0:1788813019.679709:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ef1164e400/0x1b294f297b1ec129 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.679716:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ef1164e400/0x1b294f297b1ec129 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.679735:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ef1164e400/0x1b294f297b1ec129 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.679741:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ef1164e400/0x1b294f297b1ec129 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.679746:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e400 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813019.679749:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ef1164e400/0x1b294f297b1ec129 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.679757:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ef1164e400/0x1b294f297b1ec129 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.679775:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ef1164e400/0x1b294f297b1ec129 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813019.679822:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813019.679853:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07820c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:3302:x1875706322633984:12345-0@lo:103: Request processed in 223us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813019.679860:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788813019.679981:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322633984:0@lo:103: 00010000:00010000:3.0:1788813019.680000:0:5850:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ef1164e400/0x1b294f297b1ec129 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.680008:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ef1164e400/0x1b294f297b1ec129 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813019.680014:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef1164e400/0x1b294f297b1ec129 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813019.698616:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:7615:x1875706322633728:12345-0@lo:253: Request processed in 54042us (60697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813019.698629:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788813019.698843:0:7615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f07e87b1-ea56-4ba9-97bf-449134c6ff58:7615:1875706322633728:0@lo:253: 10000000:01000000:1.0:1788813019.698857:0:7615:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788813019.698872:0:7615:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788813019.698873:0:7615:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788813019.698875:0:7615:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813019.698876:0:7615:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788813019.698877:0:7615:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813019.698879:0:7615:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813019.698880:0:7615:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788813019.698881:0:7615:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788813019.698882:0:7615:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788813019.698884:0:7615:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813019.698885:0:7615:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788813019.698899:0:7615:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788813019.705193:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788813019.705402:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788813019.705630:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788813019.705816:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788813019.706003:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788813019.706237:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788813019.707717:0:7615:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788813019.894544:0:7615:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788813019.894551:0:7615:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788813019.894584:0:7615:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788813019.894643:0:7615:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788813019.894656:0:7615:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788813019.894682:0:7615:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788813020.254850:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813021.278108:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813022.310440:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813022.366836:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322634112:0@lo:13: 00000100:00100000:3.0:1788813022.366928:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813022.367365:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322634112 00000100:00100000:0.0:1788813022.367375:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322634112 00000100:00100000:0.0:1788813022.367460:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788813022.367472:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322634112:12345-0@lo:13: 00002000:00000024:0.0:1788813022.367513:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813022.367571:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322634112:12345-0@lo:13: Request processed in 101us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813022.367578:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788813022.367656:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef35a1f480 x1875706322634112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813022.367693:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322634112:0@lo:13: 00000100:00080000:3.0:1788813022.367830:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788813023.328693:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813024.349326:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788813024.662749:0:7970:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788813024.925604:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875706322634368:0@lo:400: 00000100:00100000:0.0:1788813024.925604:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322634240:0@lo:400: 00000100:00100000:1.0:1788813024.927037:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813024.927045:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813024.927106:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1875706322634752:0@lo:400: 00000100:00100000:3.0:1788813024.927127:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322634240 00000100:00100000:3.0:1788813024.927136:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322634240 00000100:00100000:3.0:1788813024.927198:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788813024.927208:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:3299:x1875706322634240:12345-0@lo:400: 00000100:00100000:3.0:1788813024.927264:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:3299:x1875706322634240:12345-0@lo:400: Request processed in 57us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813024.927272:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788813024.927777:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322634496:0@lo:400: 00000100:00100000:1.0:1788813024.927839:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813024.928352:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813024.928360:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322634624:0@lo:400: 00000100:00100000:1.0:1788813024.928390:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813024.928422:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322634624 00000100:00100000:1.0:1788813024.928428:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322634624 00000100:00100000:1.0:1788813024.928482:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813024.928491:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322634624:12345-0@lo:400: 00000100:00100000:1.0:1788813024.928537:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322634624:12345-0@lo:400: Request processed in 48us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813024.928545:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788813024.928572:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef20e4f480 x1875706322634624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813024.928594:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322634624:0@lo:400: 00000100:00080000:0.0:1788813024.931298:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813024.931324:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813024.931461:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322634368 00000100:00100000:2.0:1788813024.931482:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322634368 00000100:00100000:2.0:1788813024.931604:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322634496 00000100:00100000:2.0:1788813024.931608:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322634496 00000100:00100000:2.0:1788813024.931637:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788813024.931646:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875706322634368:12345-0@lo:400: 00000100:00100000:2.0:1788813024.931727:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875706322634368:12345-0@lo:400: Request processed in 82us (4695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813024.931734:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788813024.931750:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788813024.931757:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322634496:12345-0@lo:400: 00000100:00100000:2.0:1788813024.931815:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322634496:12345-0@lo:400: Request processed in 59us (3975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813024.931821:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788813024.931868:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef20e4c000 x1875706322634368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813024.931882:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875706322634368:0@lo:400: 00010000:00080000:2.0:1788813024.931915:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef20e4d180 x1875706322634496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813024.931925:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322634496:0@lo:400: 00000100:00080000:2.0:1788813024.931939:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813024.935142:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322634240:0@lo:400: 00000100:00100000:2.0:1788813024.938205:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322634752 00000100:00100000:2.0:1788813024.938231:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322634752 00000100:00100000:2.0:1788813024.938313:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788813024.938323:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875706322634752:12345-0@lo:400: 00000100:00100000:2.0:1788813024.938410:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875706322634752:12345-0@lo:400: Request processed in 89us (7087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813024.938416:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788813024.938520:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788813024.938556:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef20e4d500 x1875706322634752/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813024.938571:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1875706322634752:0@lo:400: 00010000:00010000:2.0:1788813025.378712:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813026.397648:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813027.423769:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788813027.484916:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788813027.484934:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93ef197e7800 from 30 10000000:01000000:1.0:1788813027.484939:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788813027.484982:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214c600/0x1b294f297b1ec130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813027.484994:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef4214c600/0x1b294f297b1ec130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813027.485005:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef4214c600/0x1b294f297b1ec130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813027.485028:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322634880:0@lo:101: 00000100:00100000:1.0:1788813027.485090:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813027.485137:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef365bd840 going to sleep for 11 seconds 00000100:00100000:2.0:1788813027.485297:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322634880 00000100:00100000:2.0:1788813027.485306:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322634880 00000100:00100000:2.0:1788813027.485366:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788813027.485375:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:5831:x1875706322634880:12345-0@lo:101: 00010000:00010000:2.0:1788813027.485387:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813027.485397:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef21619c00/0x1b294f297b1ec137 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec130 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813027.485419:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef21619c00/0x1b294f297b1ec137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec130 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813027.485429:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef21619c00/0x1b294f297b1ec137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec130 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813027.485437:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619c00, rc 0) 00000100:00100000:2.0:1788813027.485489:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:5831:x1875706322634880:12345-0@lo:101: Request processed in 115us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813027.485495:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788813027.485820:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322634880:0@lo:101: 00010000:00010000:1.0:1788813027.485836:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef4214c600/0x1b294f297b1ec130 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec137 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813027.485845:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef4214c600/0x1b294f297b1ec130 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec137 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813027.485964:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322635008:0@lo:501: 00000100:00100000:1.0:1788813027.485994:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813027.486071:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef365bd840 going to sleep for 11 seconds 00000100:00100000:1.0:1788813027.486220:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788813027.486231:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322635136:0@lo:13: 00000100:00100000:1.0:1788813027.486261:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813027.486337:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322635136 00000100:00100000:0.0:1788813027.486342:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322635136 00000100:00100000:0.0:1788813027.486391:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788813027.486399:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322635136:12345-0@lo:13: 00002000:00000024:0.0:1788813027.486425:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813027.486473:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322635136:12345-0@lo:13: Request processed in 76us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813027.486480:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788813027.486700:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788813027.486725:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef35a1c380 x1875706322635136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813043 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813027.486752:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322635136:0@lo:13: 00000100:00100000:3.0:1788813027.490125:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322635008 00000100:00100000:3.0:1788813027.490141:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322635008 00000100:00100000:3.0:1788813027.490211:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788813027.490221:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:5831:x1875706322635008:12345-0@lo:501: 00000100:00100000:3.0:1788813027.490611:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:5831:x1875706322635008:12345-0@lo:501: Request processed in 390us (4615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813027.490619:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788813027.490755:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322635008:0@lo:501: 00000100:00100000:1.0:1788813027.490823:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322635264:0@lo:503: 00000100:00100000:1.0:1788813027.490867:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813027.490911:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef365bd840 going to sleep for 11 seconds 00000100:00100000:2.0:1788813027.491076:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322635264 00000100:00100000:2.0:1788813027.491081:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322635264 00000100:00100000:2.0:1788813027.491121:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788813027.491128:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:5831:x1875706322635264:12345-0@lo:503: 00000100:00100000:2.0:1788813027.491419:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:5831:x1875706322635264:12345-0@lo:503: Request processed in 290us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813027.491426:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788813027.491648:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322635264:0@lo:503: 00000100:00100000:1.0:1788813027.492081:0:8094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8094:1875706322635392:0@lo:502: 00000100:00100000:1.0:1788813027.492124:0:8094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813027.492158:0:8094:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef365bd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813027.492256:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322635392 00000100:00100000:2.0:1788813027.492261:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322635392 00000100:00100000:2.0:1788813027.492295:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788813027.492303:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:8094:x1875706322635392:12345-0@lo:502: 00000100:00100000:2.0:1788813027.492558:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:8094:x1875706322635392:12345-0@lo:502: Request processed in 255us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813027.492566:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788813027.492699:0:8094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8094:1875706322635392:0@lo:502: 00000100:00100000:1.0:1788813027.492743:0:8094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8094:1875706322635520:0@lo:502: 00000100:00100000:1.0:1788813027.492777:0:8094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813027.492833:0:8094:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef365bd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813027.492890:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322635520 00000100:00100000:3.0:1788813027.492906:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322635520 00000100:00100000:3.0:1788813027.492929:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788813027.492936:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:8094:x1875706322635520:12345-0@lo:502: 00000100:00100000:3.0:1788813027.493079:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:8094:x1875706322635520:12345-0@lo:502: Request processed in 143us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813027.493086:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788813027.493281:0:8094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8094:1875706322635520:0@lo:502: 00000040:00080000:1.0:1788813027.493301:0:8094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788813027.493585:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788813027.493603:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788813027.493621:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214c600/0x1b294f297b1ec130 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec137 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813027.493632:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef4214c600/0x1b294f297b1ec130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec137 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813027.493641:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788813027.493643:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1788813027.493646:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788813027.493670:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec13e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813027.493677:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec13e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813027.493686:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec13e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813027.493699:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322635648:0@lo:101: 00000100:00100000:3.0:1788813027.493730:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813027.493758:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee07c6dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813027.494221:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322635648 00000100:00100000:0.0:1788813027.494229:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322635648 00000100:00100000:0.0:1788813027.494282:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788813027.494291:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:5831:x1875706322635648:12345-0@lo:101: 00010000:00010000:0.0:1788813027.494313:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813027.494326:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef00031e00/0x1b294f297b1ec145 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec13e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813027.494350:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef00031e00/0x1b294f297b1ec145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec13e expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813027.494361:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef00031e00/0x1b294f297b1ec145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec13e expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813027.494370:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef00031e00, rc 0) 00000100:00100000:0.0:1788813027.494409:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:5831:x1875706322635648:12345-0@lo:101: Request processed in 119us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813027.494415:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788813027.494539:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322635648:0@lo:101: 00010000:00010000:3.0:1788813027.494553:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec13e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec145 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813027.494562:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec13e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec145 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813027.494608:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322635776:0@lo:501: 00000100:00100000:3.0:1788813027.494643:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813027.494672:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee07c6dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813027.495058:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322635776 00000100:00100000:1.0:1788813027.495063:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322635776 00000100:00100000:1.0:1788813027.495089:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788813027.495095:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:5831:x1875706322635776:12345-0@lo:501: 00000100:00100000:1.0:1788813027.495330:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:5831:x1875706322635776:12345-0@lo:501: Request processed in 233us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813027.495338:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788813027.495374:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322635776:0@lo:501: 00000100:00100000:1.0:1788813027.495411:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322635904:0@lo:503: 00000100:00100000:1.0:1788813027.495461:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813027.495484:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef365bdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788813027.495495:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322635904 00000100:00100000:1.0:1788813027.495498:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322635904 00000100:00100000:1.0:1788813027.495516:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788813027.495522:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:5831:x1875706322635904:12345-0@lo:503: 00000100:00100000:1.0:1788813027.495809:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:5831:x1875706322635904:12345-0@lo:503: Request processed in 260us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813027.495817:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788813027.495859:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322635904:0@lo:503: 00000100:00100000:0.0:1788813027.507174:0:8095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8095:1875706322636032:0@lo:502: 00000100:00100000:0.0:1788813027.507252:0:8095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813027.507299:0:8095:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef18d56e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788813027.507983:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322636032 00000100:00100000:2.0:1788813027.507994:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322636032 00000100:00100000:2.0:1788813027.508039:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788813027.508048:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:8095:x1875706322636032:12345-0@lo:502: 00000100:00100000:2.0:1788813027.508311:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:8095:x1875706322636032:12345-0@lo:502: Request processed in 264us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813027.508318:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788813027.508498:0:8095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8095:1875706322636032:0@lo:502: 00000020:01000000:0.0:1788813027.508531:0:8095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813027.508540:0:8095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813027.508542:0:8095:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788813027.508546:0:8095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788813027.508548:0:8095:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788813027.508569:0:8095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8095:1875706322636160:0@lo:502: 00000100:00100000:0.0:1788813027.508607:0:8095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813027.508640:0:8095:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e101c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813027.508772:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322636160 00000100:00100000:2.0:1788813027.508778:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322636160 00000100:00100000:2.0:1788813027.508826:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788813027.508834:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:8095:x1875706322636160:12345-0@lo:502: 00000100:00100000:2.0:1788813027.508981:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:8095:x1875706322636160:12345-0@lo:502: Request processed in 147us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813027.508988:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788813027.510705:0:8095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8095:1875706322636160:0@lo:502: 00000020:01000000:0.0:1788813027.510751:0:8095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813027.510771:0:8095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813027.510773:0:8095:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788813027.510778:0:8095:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788813027.510875:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788813027.510914:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788813027.510929:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec13e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec145 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813027.510947:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec13e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec145 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813027.510957:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788813027.510959:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93ef2171d800 from 30 10000000:01000000:2.0:1788813027.510962:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788813027.510995:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef21619e00/0x1b294f297b1ec14c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813027.511003:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef21619e00/0x1b294f297b1ec14c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813027.511011:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef21619e00/0x1b294f297b1ec14c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813027.511031:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322636288:0@lo:101: 00000100:00100000:2.0:1788813027.511081:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813027.511117:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef36d8c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813027.511230:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322636288 00000100:00100000:3.0:1788813027.511237:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322636288 00000100:00100000:3.0:1788813027.511283:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788813027.511292:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:5831:x1875706322636288:12345-0@lo:101: 00010000:00010000:3.0:1788813027.511304:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813027.511317:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef1164ec00/0x1b294f297b1ec153 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec14c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813027.511340:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef1164ec00/0x1b294f297b1ec153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec14c expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813027.511350:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef1164ec00/0x1b294f297b1ec153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec14c expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813027.511358:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164ec00, rc 0) 00000100:00100000:3.0:1788813027.511413:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:5831:x1875706322636288:12345-0@lo:101: Request processed in 121us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813027.511421:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788813027.511624:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322636288:0@lo:101: 00010000:00010000:0.0:1788813027.511638:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef21619e00/0x1b294f297b1ec14c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec153 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813027.511648:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef21619e00/0x1b294f297b1ec14c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec153 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813027.511696:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322636416:0@lo:501: 00000100:00100000:0.0:1788813027.511723:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813027.511747:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e101c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813027.511769:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322636416 00000100:00100000:1.0:1788813027.511775:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322636416 00000100:00100000:1.0:1788813027.511827:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788813027.511834:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:5831:x1875706322636416:12345-0@lo:501: 00000100:00100000:1.0:1788813027.512092:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:5831:x1875706322636416:12345-0@lo:501: Request processed in 257us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813027.512100:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788813027.512159:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322636416:0@lo:501: 00000100:00100000:0.0:1788813027.512187:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322636544:0@lo:503: 00000100:00100000:0.0:1788813027.512224:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813027.512249:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e101c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813027.512347:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322636544 00000100:00100000:1.0:1788813027.512352:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322636544 00000100:00100000:1.0:1788813027.512387:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788813027.512395:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:5831:x1875706322636544:12345-0@lo:503: 00000100:00100000:1.0:1788813027.512571:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:5831:x1875706322636544:12345-0@lo:503: Request processed in 177us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813027.512578:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788813027.512642:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322636544:0@lo:503: 00000100:00100000:0.0:1788813027.513478:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8097:1875706322636672:0@lo:502: 00000100:00100000:0.0:1788813027.513531:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813027.513566:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e101d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813027.513615:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322636672 00000100:00100000:1.0:1788813027.513627:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322636672 00000100:00100000:1.0:1788813027.513664:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788813027.513672:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:8097:x1875706322636672:12345-0@lo:502: 00000100:00100000:1.0:1788813027.514312:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:8097:x1875706322636672:12345-0@lo:502: Request processed in 639us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813027.514320:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788813027.514422:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8097:1875706322636672:0@lo:502: 00000100:00100000:0.0:1788813027.514482:0:8097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8097:1875706322636800:0@lo:502: 00000100:00100000:0.0:1788813027.514521:0:8097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813027.514553:0:8097:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef18d56e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788813027.514803:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322636800 00000100:00100000:2.0:1788813027.514810:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322636800 00000100:00100000:2.0:1788813027.514847:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788813027.514858:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:8097:x1875706322636800:12345-0@lo:502: 00000100:00100000:2.0:1788813027.515049:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:8097:x1875706322636800:12345-0@lo:502: Request processed in 193us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813027.515056:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788813027.515098:0:8097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8097:1875706322636800:0@lo:502: 00000040:00080000:0.0:1788813027.515251:0:8097:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788813027.515400:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788813027.515419:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788813027.515429:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef21619e00/0x1b294f297b1ec14c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec153 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813027.515441:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef21619e00/0x1b294f297b1ec14c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec153 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813027.515464:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788813027.515467:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93ef2171d800 from 5 10000000:01000000:1.0:1788813027.515469:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788813027.515497:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214da00/0x1b294f297b1ec15a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813027.515506:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef4214da00/0x1b294f297b1ec15a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813027.515515:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef4214da00/0x1b294f297b1ec15a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813027.515539:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322636928:0@lo:101: 00000100:00100000:1.0:1788813027.515573:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813027.515610:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef365bd480 going to sleep for 11 seconds 00000100:00100000:0.0:1788813027.515749:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322636928 00000100:00100000:0.0:1788813027.515754:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322636928 00000100:00100000:0.0:1788813027.515821:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788813027.515829:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:5831:x1875706322636928:12345-0@lo:101: 00010000:00010000:0.0:1788813027.515838:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813027.515852:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef00030400/0x1b294f297b1ec161 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec15a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813027.515873:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef00030400/0x1b294f297b1ec161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec15a expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813027.515883:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef00030400/0x1b294f297b1ec161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec15a expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813027.515891:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef00030400, rc 0) 00000100:00100000:0.0:1788813027.515934:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322636928:12345-0@lo:101: Request processed in 107us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813027.515941:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788813027.515979:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322636928:0@lo:101: 00010000:00010000:3.0:1788813027.515993:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef4214da00/0x1b294f297b1ec15a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec161 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813027.516003:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef4214da00/0x1b294f297b1ec15a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec161 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813027.516049:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322637056:0@lo:256: 00000100:00100000:3.0:1788813027.516090:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813027.516120:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee07c6d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788813027.517008:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322637056 00000100:00100000:0.0:1788813027.517019:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322637056 00000100:00100000:0.0:1788813027.517056:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788813027.517064:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322637056:12345-0@lo:256: 20000000:01000000:0.0:1788813027.517079:0:5827:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788813027.517093:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788813027.517096:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788813027.518125:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322637056:12345-0@lo:256: Request processed in 1058us (2030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813027.518136:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788813027.518345:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322637056:0@lo:256: 10000000:01000000:3.0:1788813027.518400:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788813027.518409:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214da00/0x1b294f297b1ec15a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec161 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813027.518419:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef4214da00/0x1b294f297b1ec15a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec161 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813027.518428:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788813027.518430:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788813027.518433:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788813027.518471:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813027.518479:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813027.518488:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813027.518506:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322637184:0@lo:101: 00000100:00100000:3.0:1788813027.518541:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813027.518615:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee07c6d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788813027.518651:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322637184 00000100:00100000:0.0:1788813027.518657:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322637184 00000100:00100000:0.0:1788813027.518724:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788813027.518732:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322637184:12345-0@lo:101: 00010000:00010000:0.0:1788813027.518751:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813027.518762:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef00030600/0x1b294f297b1ec16f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec168 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813027.518800:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef00030600/0x1b294f297b1ec16f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec168 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813027.518810:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef00030600/0x1b294f297b1ec16f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec168 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813027.518818:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef00030600, rc 0) 00000100:00100000:0.0:1788813027.518853:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322637184:12345-0@lo:101: Request processed in 121us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813027.518860:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788813027.519085:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322637184:0@lo:101: 00010000:00010000:0.0:1788813027.519098:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec168 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec16f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813027.519106:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec168 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec16f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813027.519156:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322637312:0@lo:501: 00000100:00100000:0.0:1788813027.519181:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813027.519251:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef18d56e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788813027.519284:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322637312 00000100:00100000:1.0:1788813027.519296:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322637312 00000100:00100000:1.0:1788813027.522556:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788813027.522575:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322637312:12345-0@lo:501: 00000100:00100000:0.0:1788813027.523050:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322637312:0@lo:501: 00000100:00100000:0.0:1788813027.523105:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322637440:0@lo:503: 00000100:00100000:0.0:1788813027.523150:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813027.523172:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322637312:12345-0@lo:501: Request processed in 332us (3719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813027.523182:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788813027.523351:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef18d56e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788813027.523460:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322637440 00000100:00100000:1.0:1788813027.523466:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322637440 00000100:00100000:1.0:1788813027.523495:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788813027.523501:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322637440:12345-0@lo:503: 00000100:00100000:1.0:1788813027.523849:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322637440:12345-0@lo:503: Request processed in 347us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813027.523856:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788813027.524217:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322637440:0@lo:503: 00000100:00100000:3.0:1788813027.524667:0:8098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d51500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8098:1875706322637568:0@lo:502: 00000100:00100000:3.0:1788813027.524711:0:8098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813027.524734:0:8098:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee07c6db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788813027.524945:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322637568 00000100:00100000:1.0:1788813027.524951:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322637568 00000100:00100000:1.0:1788813027.524980:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788813027.524987:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:8098:x1875706322637568:12345-0@lo:502: 00000100:00100000:1.0:1788813027.525391:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:8098:x1875706322637568:12345-0@lo:502: Request processed in 402us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813027.525398:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788813027.525497:0:8098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d51500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8098:1875706322637568:0@lo:502: 00000020:01000000:3.0:1788813027.525528:0:8098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788813027.525536:0:8098:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788813027.525542:0:8098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813027.525544:0:8098:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788813027.525551:0:8098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788813027.525554:0:8098:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:3.0:1788813027.525574:0:8098:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788813027.525577:0:8098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788813027.525590:0:8098:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93ef3591b380) 00000020:00000080:3.0:1788813027.525610:0:8098:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788813027.525614:0:8098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788813027.525678:0:8098:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788813027.525684:0:8098:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788813027.525690:0:8098:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b294f297b1ec17d 00010000:00080000:3.0:1788813027.525719:0:8098:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93ee051fa000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:3.0:1788813027.526567:0:8098:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1788813027.527219:0:8098:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788813027.527234:0:8098:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788813027.529287:0:8098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788813027.529643:0:8098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788813027.529696:0:8098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788813027.529756:0:8098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788813027.538751:0:8100:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813027.538763:0:8100:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788813027.547139:0:8098:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788813027.547156:0:8098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788813027.547196:0:8098:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788813027.547219:0:8098:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b294f297b1ec184 00000100:00080000:1.0:1788813027.547229:0:8098:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788813027.547242:0:8098:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93ee051fa000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1788813027.547292:0:8098:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ef20e4ea00 x1875706322637696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788813027.547330:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1875706322637696:0@lo:8: 00000100:00100000:1.0:1788813027.547394:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788813027.547469:0:8098:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788813027.547550:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1875706322637952:0@lo:400: 00000100:00100000:1.0:1788813027.547579:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813027.547601:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813027.547607:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875706322637824:0@lo:400: 00000100:00100000:1.0:1788813027.547629:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813027.547656:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1875706322638080:0@lo:400: 00000100:00100000:1.0:1788813027.547682:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813027.547712:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322637952 00000100:00100000:1.0:1788813027.547719:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322637952 00000100:00100000:1.0:1788813027.547761:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322637824 00000100:00100000:1.0:1788813027.547764:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322637824 00000100:00100000:1.0:1788813027.547813:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322638080 00000100:00100000:1.0:1788813027.547817:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322638080 00000100:00100000:1.0:1788813027.547836:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788813027.547844:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875706322637952:12345-0@lo:400: 00000100:00100000:1.0:1788813027.547892:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875706322637952:12345-0@lo:400: Request processed in 48us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813027.547899:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788813027.547914:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788813027.547920:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875706322637824:12345-0@lo:400: 00000100:00100000:1.0:1788813027.547948:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875706322637824:12345-0@lo:400: Request processed in 29us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813027.547964:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788813027.547977:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788813027.547983:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875706322638080:12345-0@lo:400: 00000100:00100000:1.0:1788813027.548016:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875706322638080:12345-0@lo:400: Request processed in 33us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813027.548021:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788813027.548038:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788813027.548064:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef20e4c000 x1875706322638080/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813027.548077:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1875706322638080:0@lo:400: 00010000:00080000:1.0:1788813027.548102:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef20e4c380 x1875706322637824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813027.548110:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875706322637824:0@lo:400: 00010000:00080000:1.0:1788813027.548117:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef20e4d180 x1875706322637952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813027.548123:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1875706322637952:0@lo:400: 00000020:01000000:1.0:1788813027.548172:0:8098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813027.548177:0:8098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813027.548179:0:8098:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788813027.548182:0:8098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813027.548185:0:8098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813027.548186:0:8098:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788813027.548189:0:8098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788813027.548191:0:8098:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788813027.548214:0:8098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8098:1875706322638208:0@lo:502: 00000100:00100000:1.0:1788813027.548263:0:8098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813027.548288:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322638208 00000100:00100000:1.0:1788813027.548292:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322638208 00000100:00100000:1.0:1788813027.548317:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788813027.548323:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21325850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:8098:x1875706322638208:12345-0@lo:502: 00000100:00100000:1.0:1788813027.548547:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21325850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:8098:x1875706322638208:12345-0@lo:502: Request processed in 224us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813027.548554:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788813027.548596:0:8098:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef365bdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813027.548608:0:8098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8098:1875706322638208:0@lo:502: 00000020:01000000:1.0:1788813027.548628:0:8098:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813027.548632:0:8098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813027.548633:0:8098:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788813027.548636:0:8098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1788813027.548697:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788813027.548714:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788813027.548723:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec168 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec16f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813027.548733:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec16f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813027.548743:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788813027.548746:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93ef2a35b380 from 1 10000000:01000000:1.0:1788813027.548749:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788813027.548772:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec18b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813027.548806:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec18b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813027.548823:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec18b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813027.548835:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322638336:0@lo:101: 00000100:00100000:1.0:1788813027.548862:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813027.548876:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef365bdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813027.548889:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322638336 00000100:00100000:1.0:1788813027.548893:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322638336 00000100:00100000:1.0:1788813027.548912:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788813027.548917:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21327850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322638336:12345-0@lo:101: 00010000:00010000:1.0:1788813027.548925:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813027.548935:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef4214d000/0x1b294f297b1ec192 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec18b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813027.548955:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef4214d000/0x1b294f297b1ec192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec18b expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813027.548965:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef4214d000/0x1b294f297b1ec192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec18b expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813027.548973:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef4214d000, rc 0) 00000100:00100000:1.0:1788813027.549001:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21327850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:5831:x1875706322638336:12345-0@lo:101: Request processed in 84us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813027.549007:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788813027.549035:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322638336:0@lo:101: 00010000:00010000:1.0:1788813027.549046:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec18b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec192 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813027.549064:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec18b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec192 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813027.549102:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322638464:0@lo:501: 00000100:00100000:1.0:1788813027.549127:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813027.549141:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef365bdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813027.549154:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322638464 00000100:00100000:1.0:1788813027.549157:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322638464 00000100:00100000:1.0:1788813027.549175:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788813027.549180:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21326050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:5831:x1875706322638464:12345-0@lo:501: 00000100:00100000:1.0:1788813027.549372:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21326050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:5831:x1875706322638464:12345-0@lo:501: Request processed in 191us (243us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788813027.549379:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788813027.549411:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322638464:0@lo:501: 10000000:01000000:1.0:1788813027.549428:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788813027.549434:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec18b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec192 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813027.549441:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec18b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec192 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813027.549628:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322637696 00000100:00100000:3.0:1788813027.549634:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322637696 00000100:00100000:3.0:1788813027.549666:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788813027.549672:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3298:x1875706322637696:12345-0@lo:8: 00010000:00080000:3.0:1788813027.549880:0:6675:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:3.0:1788813027.549907:0:6675:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b294f297b1ec199 00002000:00100000:3.0:1788813027.549920:0:6675:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93ee051fe000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788813027.549924:0:6675:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1788813027.549928:0:6675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788813027.550025:0:6675:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788813027.550172:0:6675:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788813027.550196:0:6675:0:(import.c:65:import_set_state_nolock()) ffff93ee051fd800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788813027.550256:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1875706322637696:12345-0@lo:8: Request processed in 583us (2862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813027.550263:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788813027.554713:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef20e4ea00 x1875706322637696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788813037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813027.554729:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788813027.554740:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788813027.554749:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788813027.554771:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788813027.554775:0:3298:0:(import.c:65:import_set_state_nolock()) ffff93ee051fa000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788813027.556181:0:3298:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788813027.556194:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1875706322637696:0@lo:8: 00000004:00080000:0.0:1788813027.556256:0:8100:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788813027.556394:0:8100:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 187942611291ns, next at 0ns, rc = 0 00000004:00080000:3.0:1788813027.632860:0:8101:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788813027.632893:0:8101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d50000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8101:1875706322638720:0@lo:7: 00000100:00100000:3.0:1788813027.632977:0:8101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813027.633021:0:8101:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef196b60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813027.633039:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322638592:0@lo:13: 00000100:00100000:3.0:1788813027.633068:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813027.633107:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322638720 00000100:00100000:3.0:1788813027.633115:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322638720 00000100:00100000:3.0:1788813027.633838:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788813027.633852:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8101:x1875706322638720:12345-0@lo:7: 00000004:00080000:0.0:1788813027.634082:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00080000:1.0:1788813027.637152:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813027.637175:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322638592 00000100:00100000:1.0:1788813027.637185:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322638592 00000100:00100000:1.0:1788813027.637244:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813027.637256:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1875706322638592:12345-0@lo:13: 00002000:00000024:1.0:1788813027.637291:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788813027.637377:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1875706322638592:12345-0@lo:13: Request processed in 124us (4307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813027.637385:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788813027.643966:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ee06d51500 x1875706322638592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813043 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813027.643991:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322638592:0@lo:13: 00002000:00080000:3.0:1788813027.644147:0:6676:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788813027.644153:0:6676:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788813027.644244:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8101:x1875706322638720:12345-0@lo:7: Request processed in 10396us (11267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813027.644254:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788813027.644476:0:8101:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ee06d50000 x1875706322638720/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788813043 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813027.644487:0:8101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d50000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8101:1875706322638720:0@lo:7: 00000004:00080000:2.0:1788813027.644500:0:8101:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788813027.644536:0:8101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8101:1875706322638848:0@lo:5: 00000100:00100000:2.0:1788813027.644576:0:8101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813027.644619:0:8101:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef35603600 going to sleep for 11 seconds 00000100:00100000:1.0:1788813027.644643:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322638848 00000100:00100000:1.0:1788813027.644651:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322638848 00000100:00100000:1.0:1788813027.644709:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788813027.644719:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8101:x1875706322638848:12345-0@lo:5: 00002000:00080000:1.0:1788813027.644742:0:6677:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788813027.644745:0:6677:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788813027.645065:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8101:x1875706322638848:12345-0@lo:5: Request processed in 347us (487us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788813027.645073:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788813027.645313:0:8101:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef3ae7a680 x1875706322638848/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788813043 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813027.645326:0:8101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8101:1875706322638848:0@lo:5: 00000004:00080000:2.0:1788813027.645334:0:8101:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788813027.645360:0:8101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8101:1875706322638976:0@lo:700: 00000100:00100000:2.0:1788813027.645387:0:8101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813027.645473:0:8101:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef35603600 going to sleep for 11 seconds 00000100:00100000:1.0:1788813027.646658:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322638976 00000100:00100000:1.0:1788813027.646670:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322638976 00000100:00100000:1.0:1788813027.646756:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813027.646766:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8101:x1875706322638976:12345-0@lo:700: 00000100:00100000:1.0:1788813027.646847:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6684:1875706322639104:0@lo:700: 00000100:00100000:1.0:1788813027.646905:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813027.646936:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef365bdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813027.647038:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322639104 00000100:00100000:0.0:1788813027.647044:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322639104 00000100:00100000:0.0:1788813027.647081:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788813027.647090:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6684:x1875706322639104:12345-0@lo:700: 40000000:02000000:1.0:1788813027.699505:0:5841:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788813027.707672:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6684:x1875706322639104:12345-0@lo:700: Request processed in 60576us (60758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813027.707686:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788813027.707994:0:6684:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef20e4ea00 x1875706322639104/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788813043 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813027.708083:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6684:1875706322639104:0@lo:700: 40000000:02000000:3.0:1788813027.708098:0:6684:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1788813027.759341:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1788813027.759368:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788813027.761610:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8101:x1875706322638976:12345-0@lo:700: Request processed in 114836us (116212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813027.761625:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788813027.761733:0:8101:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef3ae78380 x1875706322638976/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788813043 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813027.761745:0:8101:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788813027.761769:0:8101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8101:1875706322638976:0@lo:700: 00000004:02000040:2.0:1788813027.793757:0:8101:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1788813027.800007:0:8101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d50700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8101:1875706322639232:0@lo:5: 00000100:00100000:3.0:1788813027.800071:0:8101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813027.800157:0:8101:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee07c6d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788813027.802017:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322639232 00000100:00100000:1.0:1788813027.802030:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322639232 00000100:00100000:2.0:1788813027.802182:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788813027.802188:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788813027.802193:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8101:x1875706322639232:12345-0@lo:5: 00000100:00100000:1.0:1788813027.802196:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:2.0:1788813027.811339:0:6676:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788813027.811358:0:6676:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788813027.817519:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8101:x1875706322639232:12345-0@lo:5: Request processed in 15320us (17440us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788813027.817538:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788813027.817609:0:8101:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ee06d50700 x1875706322639232/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788813043 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813027.817626:0:8101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d50700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8101:1875706322639232:0@lo:5: 00000004:00080000:2.0:1788813027.817642:0:8101:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1788813028.445378:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788813028.707007:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1788813029.109680:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813029.109711:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307936384 00000100:00100000:1.0:1788813029.109721:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307936384 00000100:00100000:1.0:1788813029.109771:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 110 00000100:00100000:1.0:1788813029.109793:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2362:x1875706307936384:12345-192.168.203.13@tcp:250: 00010000:00080000:1.0:1788813029.109819:0:5827:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 2aa2133f-e434-4510-82b0-9799a685adfa@192.168.203.13@tcp t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:1.0:1788813029.109847:0:5827:0:(genops.c:1384:class_connect()) connect: client 2aa2133f-e434-4510-82b0-9799a685adfa, cookie 0x1b294f297b1ec1a0 00000100:00080000:1.0:1788813029.110100:0:5827:0:(import.c:65:import_set_state_nolock()) ffff93ef36d80000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813029.110159:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+5:2362:x1875706307936384:12345-192.168.203.13@tcp:250: Request processed in 379us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813029.110167:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 110 00000100:00100000:1.0:1788813029.122684:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813029.122863:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307936512 00000100:00100000:2.0:1788813029.122873:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307936512 00000100:00100000:2.0:1788813029.122969:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 111 00000100:00100000:2.0:1788813029.122979:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+5:5586:x1875706307936512:12345-192.168.203.13@tcp:101: 00010000:00010000:2.0:1788813029.122994:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813029.123010:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef21618000/0x1b294f297b1ec1a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2926 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.123038:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef21618000/0x1b294f297b1ec1a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2926 expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.123048:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef21618000/0x1b294f297b1ec1a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2926 expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.123057:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21618000, rc 0) 00000100:00100000:2.0:1788813029.123115:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+6:5586:x1875706307936512:12345-192.168.203.13@tcp:101: Request processed in 138us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813029.123132:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 111 00000100:00100000:0.0:1788813029.129126:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813029.129299:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307936640 00000100:00100000:1.0:1788813029.129309:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307936640 00000100:00100000:1.0:1788813029.129364:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 112 00000100:00100000:1.0:1788813029.129375:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21326c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+6:5586:x1875706307936640:12345-192.168.203.13@tcp:501: 00000100:00100000:1.0:1788813029.130313:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21326c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+6:5586:x1875706307936640:12345-192.168.203.13@tcp:501: Request processed in 935us (1187us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788813029.130324:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 112 00000100:00100000:3.0:1788813029.133531:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813029.133957:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307936768 00000100:00100000:2.0:1788813029.133967:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307936768 00000100:00100000:2.0:1788813029.134031:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:2.0:1788813029.134041:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+6:5586:x1875706307936768:12345-192.168.203.13@tcp:101: 00010000:00010000:2.0:1788813029.134057:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813029.134072:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ec1ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x78c59908dfce292d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.134099:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ec1ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce292d expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.134110:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ec1ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce292d expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813029.134119:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21618a00, rc 0) 00000100:00100000:2.0:1788813029.134179:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+7:5586:x1875706307936768:12345-192.168.203.13@tcp:101: Request processed in 139us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813029.134186:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:2.0:1788813029.140876:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813029.141167:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307936896 00000100:00100000:1.0:1788813029.141177:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307936896 00000100:00100000:1.0:1788813029.141419:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:1.0:1788813029.141430:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21326850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+7:5586:x1875706307936896:12345-192.168.203.13@tcp:501: 00000100:00100000:1.0:1788813029.141705:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21326850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+8:5586:x1875706307936896:12345-192.168.203.13@tcp:501: Request processed in 276us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813029.141714:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:3.0:1788813029.145561:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813029.145598:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307937024 00000100:00100000:3.0:1788813029.145608:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307937024 00000100:00100000:3.0:1788813029.145666:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:3.0:1788813029.145677:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21325450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+8:5586:x1875706307937024:12345-192.168.203.13@tcp:503: 00000100:00100000:2.0:1788813029.146114:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21325450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+8:5586:x1875706307937024:12345-192.168.203.13@tcp:503: Request processed in 436us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813029.146124:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:0.0:1788813029.152578:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813029.152717:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307937152 00000100:00100000:3.0:1788813029.152726:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307937152 00000100:00100000:3.0:1788813029.152778:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:3.0:1788813029.152815:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+8:5605:x1875706307937152:12345-192.168.203.13@tcp:502: 00000100:00100000:3.0:1788813029.153183:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+8:5605:x1875706307937152:12345-192.168.203.13@tcp:502: Request processed in 370us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813029.153192:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:1.0:1788813029.181621:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813029.181664:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307937280 00000100:00100000:1.0:1788813029.181674:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307937280 00000100:00100000:1.0:1788813029.181723:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:1.0:1788813029.181733:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21325c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+8:5605:x1875706307937280:12345-192.168.203.13@tcp:502: 00000100:00100000:1.0:1788813029.183276:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21325c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+8:5605:x1875706307937280:12345-192.168.203.13@tcp:502: Request processed in 262us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813029.183291:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:1.0:1788813029.188557:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813029.188821:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307937408 00000100:00100000:3.0:1788813029.188832:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307937408 00000100:00100000:1.0:1788813029.189111:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:1.0:1788813029.189123:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21327050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+8:5586:x1875706307937408:12345-192.168.203.13@tcp:101: 00010000:00010000:1.0:1788813029.189139:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813029.189157:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef4214d800/0x1b294f297b1ec1b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2957 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.189186:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef4214d800/0x1b294f297b1ec1b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2957 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.190861:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef4214d800/0x1b294f297b1ec1b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2957 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813029.190874:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef4214d800, rc 0) 00000100:00100000:1.0:1788813029.191589:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21327050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+9:5586:x1875706307937408:12345-192.168.203.13@tcp:101: Request processed in 2465us (3038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813029.191610:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:1.0:1788813029.199093:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813029.199248:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307937536 00000100:00100000:3.0:1788813029.199259:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307937536 00000100:00100000:3.0:1788813029.199422:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:3.0:1788813029.199434:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+9:5586:x1875706307937536:12345-192.168.203.13@tcp:256: 20000000:01000000:3.0:1788813029.199471:0:5829:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788813029.199492:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788813029.199497:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788813029.199499:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788813029.199501:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788813029.204084:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+9:5586:x1875706307937536:12345-192.168.203.13@tcp:256: Request processed in 4641us (4988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813029.204097:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:1.0:1788813029.209214:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813029.209362:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307937664 00000100:00100000:3.0:1788813029.209372:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307937664 00000100:00100000:3.0:1788813029.209701:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:3.0:1788813029.209712:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21326450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+9:5586:x1875706307937664:12345-192.168.203.13@tcp:101: 00010000:00010000:3.0:1788813029.209727:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813029.209745:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef1164ee00/0x1b294f297b1ec1bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x78c59908dfce295e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813029.209772:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef1164ee00/0x1b294f297b1ec1bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce295e expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813029.209817:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef1164ee00/0x1b294f297b1ec1bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce295e expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813029.209831:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164ee00, rc 0) 00000100:00100000:3.0:1788813029.209879:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21326450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+10:5586:x1875706307937664:12345-192.168.203.13@tcp:101: Request processed in 169us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813029.209884:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:2.0:1788813029.211923:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813029.211962:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307937792 00000100:00100000:3.0:1788813029.211973:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307937792 00000100:00100000:3.0:1788813029.212024:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:3.0:1788813029.212033:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07822850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+10:5586:x1875706307937792:12345-192.168.203.13@tcp:501: 00000100:00100000:3.0:1788813029.212288:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07822850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+10:5586:x1875706307937792:12345-192.168.203.13@tcp:501: Request processed in 255us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813029.212296:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:3.0:1788813029.214647:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813029.214730:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307937920 00000100:00100000:1.0:1788813029.214739:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307937920 00000100:00100000:1.0:1788813029.214810:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:1.0:1788813029.214819:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+10:5586:x1875706307937920:12345-192.168.203.13@tcp:503: 00000100:00100000:1.0:1788813029.215176:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+10:5586:x1875706307937920:12345-192.168.203.13@tcp:503: Request processed in 356us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813029.215193:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:2.0:1788813029.226759:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813029.226821:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307938048 00000100:00100000:2.0:1788813029.226830:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307938048 00000100:00100000:2.0:1788813029.226896:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:2.0:1788813029.226906:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+10:5609:x1875706307938048:12345-192.168.203.13@tcp:502: 00000100:00100000:2.0:1788813029.227150:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+10:5609:x1875706307938048:12345-192.168.203.13@tcp:502: Request processed in 244us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813029.227159:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:2.0:1788813029.234111:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813029.234261:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307938176 00000100:00100000:3.0:1788813029.234271:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307938176 00000100:00100000:3.0:1788813029.234365:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00100000:3.0:1788813029.234376:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+10:5609:x1875706307938176:12345-192.168.203.13@tcp:502: 00000100:00100000:3.0:1788813029.234603:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+10:5609:x1875706307938176:12345-192.168.203.13@tcp:502: Request processed in 229us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813029.234611:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00100000:3.0:1788813029.240433:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813029.240651:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307938304 00000100:00100000:1.0:1788813029.240661:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307938304 00000100:00100000:1.0:1788813029.240706:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:1.0:1788813029.240715:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2362:x1875706307938304:12345-192.168.203.13@tcp:38: 00010000:00080000:1.0:1788813029.241160:0:7630:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 9c560788-da9a-41fd-952d-091d96dace11@192.168.203.13@tcp t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:1.0:1788813029.241477:0:7630:0:(genops.c:1384:class_connect()) connect: client 9c560788-da9a-41fd-952d-091d96dace11, cookie 0x1b294f297b1ec1c3 00000004:00100000:1.0:1788813029.241504:0:7630:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788813029.241510:0:7630:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788813029.271297:0:7630:0:(import.c:65:import_set_state_nolock()) ffff93ef36d84000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813029.271392:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+6:2362:x1875706307938304:12345-192.168.203.13@tcp:38: Request processed in 30676us (30968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813029.271403:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00010000:00010000:2.0:1788813029.471524:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813030.277139:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813030.277221:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307938432 00000100:00100000:2.0:1788813030.277232:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307938432 00000100:00080000:1.0:1788813030.277341:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813030.277379:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:2.0:1788813030.277389:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+6:0:x1875706307938432:12345-192.168.203.13@tcp:41: 00000004:00000024:2.0:1788813030.277427:0:5835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788813030.277505:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+6:0:x1875706307938432:12345-192.168.203.13@tcp:41: Request processed in 117us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813030.277512:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:0.0:1788813030.280912:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813030.282146:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307938560 00000100:00100000:3.0:1788813030.282158:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307938560 00000100:00100000:3.0:1788813030.282226:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:3.0:1788813030.282235:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+6:5586:x1875706307938560:12345-192.168.203.13@tcp:41: 00000004:00000024:3.0:1788813030.282267:0:5836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788813030.282346:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+6:5586:x1875706307938560:12345-192.168.203.13@tcp:41: Request processed in 112us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813030.282352:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:0.0:1788813030.284190:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813030.284265:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307938688 00000100:00100000:3.0:1788813030.284275:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307938688 00000100:00100000:3.0:1788813030.284328:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:3.0:1788813030.284338:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+6:5586:x1875706307938688:12345-192.168.203.13@tcp:40: 00000100:00100000:3.0:1788813030.284417:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+6:5586:x1875706307938688:12345-192.168.203.13@tcp:40: Request processed in 80us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813030.284425:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:0.0:1788813030.288312:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813030.288352:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813030.288509:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307939072 00000100:00100000:3.0:1788813030.288520:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307939072 00000100:00100000:3.0:1788813030.288580:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:3.0:1788813030.288591:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+6:5586:x1875706307939072:12345-192.168.203.13@tcp:33: 00000100:00100000:0.0:1788813030.289998:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813030.290057:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813030.290086:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307938816 00000100:00100000:0.0:1788813030.290093:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307938816 00000100:00100000:0.0:1788813030.290120:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307938944 00000100:00100000:0.0:1788813030.290123:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307938944 00000100:00100000:0.0:1788813030.290141:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:0.0:1788813030.290156:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1875706307938816:12345-192.168.203.13@tcp:8: 00010000:00080000:0.0:1788813030.290183:0:6677:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 9c560788-da9a-41fd-952d-091d96dace11@192.168.203.13@tcp t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:0.0:1788813030.290213:0:6677:0:(genops.c:1384:class_connect()) connect: client 9c560788-da9a-41fd-952d-091d96dace11, cookie 0x1b294f297b1ec1ca 00002000:00100000:0.0:1788813030.290224:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9c560788-da9a-41fd-952d-091d96dace11/ffff93ef212e2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788813030.290246:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788813030.290589:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788813030.290616:0:6677:0:(import.c:65:import_set_state_nolock()) ffff93ef212e2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788813030.290681:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2362:x1875706307938816:12345-192.168.203.13@tcp:8: Request processed in 524us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813030.290688:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:0.0:1788813030.290707:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:0.0:1788813030.290712:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1875706307938944:12345-192.168.203.13@tcp:8: 00010000:00080000:0.0:1788813030.290728:0:6677:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 9c560788-da9a-41fd-952d-091d96dace11@192.168.203.13@tcp t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:0.0:1788813030.290744:0:6677:0:(genops.c:1384:class_connect()) connect: client 9c560788-da9a-41fd-952d-091d96dace11, cookie 0x1b294f297b1ec1d1 00002000:00100000:0.0:1788813030.290750:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9c560788-da9a-41fd-952d-091d96dace11/ffff93ef212e6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788813030.290764:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788813030.291994:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307939200 00000100:00100000:2.0:1788813030.292008:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307939200 00000100:00100000:2.0:1788813030.292063:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 125 00000100:00100000:2.0:1788813030.292072:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+10:2366:x1875706307939200:12345-192.168.203.13@tcp:400: 00000100:00100000:2.0:1788813030.292129:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+10:2366:x1875706307939200:12345-192.168.203.13@tcp:400: Request processed in 59us (3776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813030.292136:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 125 00002000:00080000:0.0:1788813030.293267:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788813030.293307:0:6677:0:(import.c:65:import_set_state_nolock()) ffff93ef212e6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788813030.293355:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2362:x1875706307938944:12345-192.168.203.13@tcp:8: Request processed in 2641us (3297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813030.293364:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000004:00080000:3.0:1788813030.309260:0:5837:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 20598us 00000004:00200000:3.0:1788813030.322610:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788813030.322799:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+6:5586:x1875706307939072:12345-192.168.203.13@tcp:33: Request processed in 34190us (34478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813030.322810:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00010000:00010000:3.0:1788813030.493066:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813030.498625:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813030.498768:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307939328 00000100:00100000:1.0:1788813030.498778:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307939328 00000100:00100000:1.0:1788813030.498904:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:1.0:1788813030.498915:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+6:5626:x1875706307939328:12345-192.168.203.13@tcp:101: 00010000:00010000:1.0:1788813030.499006:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813030.499033:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214ce00/0x1b294f297b1ec1d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2988 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813030.499101:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1ec1df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813030.499115:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1ec1df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813030.499130:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1ec1df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813030.499164:0:7630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788813030.499168:0:7630:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813030.499184:0:7630:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1ec1df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813030.499208:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214ce00/0x1b294f297b1ec1d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2988 expref: 8 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813030.499264:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1ec1df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2988 expref: 7 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813030.499273:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:1.0:1788813030.499276:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813030.499280:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef4214d600, rc 0) 00000100:00100000:1.0:1788813030.499348:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+7:5626:x1875706307939328:12345-192.168.203.13@tcp:101: Request processed in 435us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813030.499681:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000001:00100000:3.0:1788813030.601065:0:6700:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9c560788-da9a-41fd-952d-091d96dace11 00010000:00010000:2.0:1788813031.517126:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813032.319862:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813032.319938:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307939456 00000100:00100000:3.0:1788813032.319948:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307939456 00000100:00100000:3.0:1788813032.320083:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:3.0:1788813032.320093:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+7:5678:x1875706307939456:12345-192.168.203.13@tcp:41: 00000004:00000024:3.0:1788813032.320135:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788813032.320201:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+7:5678:x1875706307939456:12345-192.168.203.13@tcp:41: Request processed in 110us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813032.320209:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00080000:1.0:1788813032.320519:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813032.325200:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813032.325373:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307939584 00000100:00100000:1.0:1788813032.325389:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307939584 00000100:00100000:1.0:1788813032.325542:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:1.0:1788813032.325553:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9c560788-da9a-41fd-952d-091d96dace11+5:5678:x1875706307939584:12345-192.168.203.13@tcp:13: 00002000:00000024:1.0:1788813032.325593:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813032.325665:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9c560788-da9a-41fd-952d-091d96dace11+5:5678:x1875706307939584:12345-192.168.203.13@tcp:13: Request processed in 113us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813032.325672:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00080000:2.0:1788813032.326433:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813032.328676:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813032.328840:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307939712 00000100:00100000:2.0:1788813032.328867:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307939712 00000100:00100000:2.0:1788813032.328969:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1788813032.328980:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9c560788-da9a-41fd-952d-091d96dace11+6:5678:x1875706307939712:12345-192.168.203.13@tcp:13: 00002000:00000024:2.0:1788813032.329015:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788813032.329100:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813032.330067:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9c560788-da9a-41fd-952d-091d96dace11+6:5678:x1875706307939712:12345-192.168.203.13@tcp:13: Request processed in 1085us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813032.330078:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00010000:00010000:3.0:1788813032.543379:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813032.606380:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322639616:0@lo:400: 00000100:00100000:3.0:1788813032.606466:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813032.606527:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813032.606534:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322639744:0@lo:400: 00000100:00100000:3.0:1788813032.606568:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813032.606619:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322639616 00000100:00100000:3.0:1788813032.606626:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322639616 00000100:00100000:3.0:1788813032.606682:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788813032.606691:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322639616:12345-0@lo:400: 00000100:00100000:3.0:1788813032.606746:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322639616:12345-0@lo:400: Request processed in 56us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813032.606752:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788813032.606814:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322639744 00000100:00100000:3.0:1788813032.606819:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322639744 00000100:00100000:3.0:1788813032.606848:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788813032.606856:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322639744:12345-0@lo:400: 00000100:00100000:3.0:1788813032.606891:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322639744:12345-0@lo:400: Request processed in 37us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813032.606897:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788813032.606913:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788813032.606917:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788813032.606944:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ee06d53100 x1875706322639744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813032.606958:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322639744:0@lo:400: 00000100:00100000:3.0:1788813032.606971:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322639616:0@lo:400: 00000100:00100000:1.0:1788813032.607057:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322639360:0@lo:400: 00000100:00100000:1.0:1788813032.607091:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813032.607122:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322639872:0@lo:400: 00000100:00100000:1.0:1788813032.607143:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813032.607172:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788813032.607178:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322639488:0@lo:400: 00000100:00100000:1.0:1788813032.607209:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813032.607228:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322640000:0@lo:400: 00000100:00100000:1.0:1788813032.607259:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813032.607291:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322639872 00000100:00100000:1.0:1788813032.607296:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322639872 00000100:00100000:1.0:1788813032.607334:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322639488 00000100:00100000:1.0:1788813032.607337:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322639488 00000100:00100000:1.0:1788813032.607356:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788813032.607365:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875706322639872:12345-0@lo:400: 00000100:00100000:2.0:1788813032.607369:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813032.607382:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322640128:0@lo:13: 00000100:00100000:1.0:1788813032.607410:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875706322639872:12345-0@lo:400: Request processed in 46us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813032.607427:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788813032.607433:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813032.607447:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788813032.607455:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322639488:12345-0@lo:400: 00000100:00100000:2.0:1788813032.607478:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322640128 00000100:00100000:2.0:1788813032.607483:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322640128 00000100:00100000:2.0:1788813032.607521:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788813032.607529:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322640128:12345-0@lo:13: 00002000:00000024:2.0:1788813032.607543:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813032.608203:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322639360 00000100:00100000:3.0:1788813032.608211:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322639360 00000100:00100000:3.0:1788813032.608246:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788813032.608253:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3301:x1875706322639360:12345-0@lo:400: 00000100:00100000:2.0:1788813032.613695:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322640128:12345-0@lo:13: Request processed in 6155us (6253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813032.613711:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788813032.613792:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef3ae7a680 x1875706322640128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813048 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813032.613816:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322640128:0@lo:13: 00000100:00100000:1.0:1788813032.615445:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322639488:12345-0@lo:400: Request processed in 7953us (8197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813032.615459:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788813032.615503:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322640000 00000100:00100000:1.0:1788813032.615512:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322640000 00000100:00100000:1.0:1788813032.615565:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813032.615574:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322640000:12345-0@lo:400: 00000100:00080000:2.0:1788813032.615585:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813032.615593:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813032.615645:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322640000:12345-0@lo:400: Request processed in 72us (8385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813032.615651:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813032.615693:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322639488:0@lo:400: 00010000:00080000:1.0:1788813032.615711:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ee06d52d80 x1875706322640000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813032.615739:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788813032.615754:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322640000:0@lo:400: 00000100:00100000:1.0:1788813032.615771:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322639872:0@lo:400: 00000100:00100000:3.0:1788813032.619597:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3301:x1875706322639360:12345-0@lo:400: Request processed in 11335us (12496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813032.619612:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788813032.626696:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322639360:0@lo:400: 00000100:00100000:1.0:1788813033.121961:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788813033.121983:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322640256:0@lo:13: 00000100:00100000:1.0:1788813033.122041:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813033.122101:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322640256 00000100:00100000:1.0:1788813033.122108:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322640256 00000100:00100000:1.0:1788813033.122150:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788813033.122159:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322640256:12345-0@lo:13: 00002000:00000024:1.0:1788813033.122181:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813033.122222:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322640256:12345-0@lo:13: Request processed in 64us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813033.122229:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788813033.122270:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef36b23b80 x1875706322640256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813033.122288:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322640256:0@lo:13: 00010000:00010000:2.0:1788813033.567076:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788813034.566562:0:8284:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788813034.590569:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788813034.696274:0:5856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9c560788-da9a-41fd-952d-091d96dace11 00000001:00100000:3.0:1788813034.705956:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9c560788-da9a-41fd-952d-091d96dace11 00000100:00100000:3.0:1788813035.468775:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813035.468882:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813035.468922:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813035.468956:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813035.469142:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307939840 00000100:00100000:1.0:1788813035.469156:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307939840 00000100:00100000:1.0:1788813035.469238:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 127 00000100:00100000:1.0:1788813035.469250:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+10:2364:x1875706307939840:12345-192.168.203.13@tcp:400: 00000100:00100000:2.0:1788813035.469283:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307940096 00000100:00100000:2.0:1788813035.469289:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307940096 00000100:00100000:2.0:1788813035.469337:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307940224 00000100:00100000:2.0:1788813035.469349:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307940224 00000100:00100000:1.0:1788813035.469358:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+10:2364:x1875706307939840:12345-192.168.203.13@tcp:400: Request processed in 98us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813035.469375:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 127 00000100:00100000:2.0:1788813035.469379:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:2.0:1788813035.469390:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+5:2364:x1875706307940096:12345-192.168.203.13@tcp:400: 00000100:00100000:1.0:1788813035.469434:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307939968 00000100:00100000:2.0:1788813035.469440:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+5:2364:x1875706307940096:12345-192.168.203.13@tcp:400: Request processed in 52us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813035.469441:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307939968 00000100:00100000:2.0:1788813035.469451:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:2.0:1788813035.469470:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1788813035.469480:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+5:2364:x1875706307940224:12345-192.168.203.13@tcp:400: 00000100:00100000:1.0:1788813035.469487:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1788813035.469498:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+6:2364:x1875706307939968:12345-192.168.203.13@tcp:400: 00000100:00100000:2.0:1788813035.469510:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+5:2364:x1875706307940224:12345-192.168.203.13@tcp:400: Request processed in 32us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813035.469518:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00080000:3.0:1788813035.469541:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813035.469548:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813035.469548:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+6:2364:x1875706307939968:12345-192.168.203.13@tcp:400: Request processed in 51us (625us total) trans 0 rc 0/0 00000100:00080000:3.0:1788813035.469552:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813035.469559:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00010000:00010000:2.0:1788813035.613108:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813036.638046:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788813037.471679:0:8434:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe3a128b50 20000000:00000080:1.0:1788813037.471695:0:8434:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93ef36b5fc00 uarg=0000000000000000 20000000:01000000:1.0:1788813037.471728:0:8434:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788813037.471731:0:8434:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788813037.471733:0:8434:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788813037.471738:0:8434:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788813037.471743:0:8434:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788813037.471756:0:8434:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788813037.471758:0:8434:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788813037.472057:0:8434:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788813037.472060:0:8434:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788813037.472732:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1788813037.473247:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1788813037.473309:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1788813037.473348:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1788813037.473359:0:8434:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788813037.473361:0:8434:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788813037.474121:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1788813037.474439:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1788813037.474484:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1788813037.474536:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1788813037.474548:0:8434:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788813037.474550:0:8434:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788813037.475237:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788813037.475538:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788813037.475595:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1788813037.475629:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1788813037.475639:0:8434:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788813037.475641:0:8434:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788813037.476216:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1788813037.476539:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1788813037.476581:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1788813037.476616:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:1.0:1788813037.476631:0:8434:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788813037.476650:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ef4214c200/0x1b294f297b1ec1e6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813037.476667:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef21618400/0x1b294f297b1ec0e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec0dc expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813037.476675:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef1164f600/0x1b294f297b1ec10d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec106 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813037.476681:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef21619c00/0x1b294f297b1ec137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec130 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813037.476688:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef00031e00/0x1b294f297b1ec145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec13e expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813037.476694:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef1164ec00/0x1b294f297b1ec153 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec14c expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813037.476701:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef00030600/0x1b294f297b1ec16f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec168 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813037.476707:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef4214d000/0x1b294f297b1ec192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec18b expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813037.476727:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef21618000/0x1b294f297b1ec1a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2926 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813037.476734:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ec1ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce292d expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813037.476741:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ef4214c200/0x1b294f297b1ec1e6 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813037.476778:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ec1ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce292d expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813037.476940:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ec1ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce292d expref: 9 pid: 5828 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813037.476953:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b23b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875706322640384:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788813037.477091:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef21618000/0x1b294f297b1ec1a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2926 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813037.477100:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ef21618000/0x1b294f297b1ec1a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2926 expref: 9 pid: 5828 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813037.477108:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b21880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875706322640512:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788813037.477139:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef4214d000/0x1b294f297b1ec192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ec18b expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813037.477147:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ef4214d000/0x1b294f297b1ec192 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ec18b expref: 18 pid: 5829 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813037.477168:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b21c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875706322640640:0@lo:104: 00000100:00100000:1.0:1788813037.477207:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788813037.477241:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef00030600/0x1b294f297b1ec16f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ec168 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813037.477249:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ef00030600/0x1b294f297b1ec16f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ec168 expref: 18 pid: 5828 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813037.477257:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b22300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875706322640768:0@lo:104: 00000100:00100000:1.0:1788813037.477282:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788813037.477348:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef1164ec00/0x1b294f297b1ec153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ec14c expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813037.477357:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ef1164ec00/0x1b294f297b1ec153 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ec14c expref: 18 pid: 5829 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813037.477365:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b21500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875706322640896:0@lo:104: 00010000:00010000:1.0:1788813037.477403:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef00031e00/0x1b294f297b1ec145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ec13e expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813037.477410:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ef00031e00/0x1b294f297b1ec145 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ec13e expref: 18 pid: 5827 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813037.477417:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b20000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875706322641024:0@lo:104: 00010000:00010000:1.0:1788813037.477439:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef21619c00/0x1b294f297b1ec137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ec130 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813037.477446:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ef21619c00/0x1b294f297b1ec137 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ec130 expref: 18 pid: 5828 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813037.477462:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b23480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875706322641152:0@lo:104: 00010000:00010000:1.0:1788813037.477487:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef1164f600/0x1b294f297b1ec10d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ec106 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813037.477495:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ef1164f600/0x1b294f297b1ec10d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ec106 expref: 18 pid: 5827 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813037.477502:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b21180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875706322641280:0@lo:104: 00010000:00010000:1.0:1788813037.477523:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef21618400/0x1b294f297b1ec0e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ec0dc expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813037.477530:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ef21618400/0x1b294f297b1ec0e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ec0dc expref: 18 pid: 5828 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813037.477537:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b20700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875706322641408:0@lo:104: 00000100:00100000:1.0:1788813037.477565:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef19c80cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813037.477807:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788813037.477827:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813037.477839:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813037.477847:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813037.477855:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813037.477874:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813037.477884:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322640640 00000100:00100000:3.0:1788813037.477890:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322640640 00000100:00100000:3.0:1788813037.477925:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322640768 00000100:00100000:3.0:1788813037.477928:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322640768 00000100:00100000:3.0:1788813037.477938:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322640896 00000100:00100000:3.0:1788813037.477940:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322640896 00000100:00100000:3.0:1788813037.477949:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322641024 00000100:00100000:3.0:1788813037.477951:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322641024 00000100:00100000:3.0:1788813037.477959:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322641152 00000100:00100000:3.0:1788813037.477960:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322641152 00000100:00100000:3.0:1788813037.477968:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322641280 00000100:00100000:3.0:1788813037.477970:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322641280 00000100:00100000:3.0:1788813037.477977:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322641408 00000100:00100000:3.0:1788813037.477979:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322641408 00000100:00100000:3.0:1788813037.477991:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788813037.477999:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+9:8434:x1875706322640640:12345-0@lo:104: 00010000:00010000:3.0:1788813037.478011:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec18b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec192 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478079:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788813037.478084:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+9:8434:x1875706322640640:12345-0@lo:104: Request processed in 86us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813037.478091:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788813037.478106:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788813037.478112:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee04922850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+8:8434:x1875706322640768:12345-0@lo:104: 00010000:00010000:3.0:1788813037.478118:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec16f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478148:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788813037.478154:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee04922850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+8:8434:x1875706322640768:12345-0@lo:104: Request processed in 42us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813037.478159:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788813037.478188:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788813037.478194:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+7:8434:x1875706322640896:12345-0@lo:104: 00010000:00010000:3.0:1788813037.478200:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef21619e00/0x1b294f297b1ec14c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec153 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478222:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788813037.478226:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+7:8434:x1875706322640896:12345-0@lo:104: Request processed in 32us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813037.478231:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788813037.478241:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788813037.478246:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+6:8434:x1875706322641024:12345-0@lo:104: 00010000:00010000:3.0:1788813037.478252:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec13e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec145 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478281:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788813037.478286:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+6:8434:x1875706322641024:12345-0@lo:104: Request processed in 41us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813037.478292:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788813037.478303:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788813037.478309:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+5:8434:x1875706322641152:12345-0@lo:104: 00010000:00010000:3.0:1788813037.478316:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef4214c600/0x1b294f297b1ec130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec137 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478337:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788813037.478341:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+5:8434:x1875706322641152:12345-0@lo:104: Request processed in 34us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813037.478346:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788813037.478355:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788813037.478360:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+4:8434:x1875706322641280:12345-0@lo:104: 00010000:00010000:3.0:1788813037.478366:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec10d expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478399:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1788813037.478404:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+4:8434:x1875706322641280:12345-0@lo:104: Request processed in 44us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813037.478409:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788813037.478420:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788813037.478425:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:8434:x1875706322641408:12345-0@lo:104: 00010000:00010000:3.0:1788813037.478432:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef1164e800/0x1b294f297b1ec0dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec0e3 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478462:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1788813037.478466:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:8434:x1875706322641408:12345-0@lo:104: Request processed in 42us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813037.478471:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1788813037.478487:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788813037.478492:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec18b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec192 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478499:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214cc00 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:3.0:1788813037.478503:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec18b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ec192 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478511:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec18b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ec192 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813037.478518:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec18b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ec192 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813037.478523:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813037.478546:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec18b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec192 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478552:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813037.478569:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec18b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec192 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478576:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec18b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec192 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478599:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788813037.478602:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec16f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478608:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164fc00 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:3.0:1788813037.478611:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ec16f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478618:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ec16f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813037.478624:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ec16f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813037.478630:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813037.478644:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec168 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec16f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478649:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813037.478655:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec168 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec16f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478661:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec168 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec16f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478669:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788813037.478672:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef21619e00/0x1b294f297b1ec14c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec153 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478686:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619e00 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:3.0:1788813037.478689:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef21619e00/0x1b294f297b1ec14c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ec153 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478695:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef21619e00/0x1b294f297b1ec14c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ec153 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813037.478702:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef21619e00/0x1b294f297b1ec14c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ec153 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813037.478706:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813037.478716:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef21619e00/0x1b294f297b1ec14c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec153 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478721:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813037.478736:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef21619e00/0x1b294f297b1ec14c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec153 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478742:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef21619e00/0x1b294f297b1ec14c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec153 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478750:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788813037.478753:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec13e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec145 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478758:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e400 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:3.0:1788813037.478761:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec13e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ec145 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478775:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec13e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ec145 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813037.478800:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec13e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ec145 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813037.478805:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813037.478817:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec13e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec145 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478822:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813037.478827:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec13e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec145 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478833:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec13e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec145 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478841:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788813037.478844:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef4214c600/0x1b294f297b1ec130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec137 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478849:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214c600 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:3.0:1788813037.478851:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214c600/0x1b294f297b1ec130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ec137 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478857:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef4214c600/0x1b294f297b1ec130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ec137 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813037.478863:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214c600/0x1b294f297b1ec130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ec137 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813037.478872:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813037.478884:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef4214c600/0x1b294f297b1ec130 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec137 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478889:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813037.478893:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef4214c600/0x1b294f297b1ec130 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec137 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478899:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef4214c600/0x1b294f297b1ec130 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec137 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478907:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788813037.478910:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec10d expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478915:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef00031a00 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:3.0:1788813037.478918:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ec10d expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478924:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ec10d expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813037.478929:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ec10d expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813037.478934:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813037.478943:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec106 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec10d expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478948:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813037.478958:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec106 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec10d expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478964:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec106 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec10d expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478972:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813037.478975:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef1164e800/0x1b294f297b1ec0dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec0e3 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478980:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e800 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:3.0:1788813037.478982:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef1164e800/0x1b294f297b1ec0dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ec0e3 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.478989:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef1164e800/0x1b294f297b1ec0dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ec0e3 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813037.478994:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef1164e800/0x1b294f297b1ec0dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ec0e3 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813037.478999:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813037.479008:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef1164e800/0x1b294f297b1ec0dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec0e3 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.479013:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813037.479017:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef1164e800/0x1b294f297b1ec0dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec0e3 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.479022:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef1164e800/0x1b294f297b1ec0dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec0e3 expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.479034:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813037.479039:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813037.479041:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813037.479057:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322641536:0@lo:103: 00000100:00100000:3.0:1788813037.479089:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813037.479107:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322642048:0@lo:103: 00000100:00100000:3.0:1788813037.479121:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813037.479139:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788813037.479144:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322641664:0@lo:103: 00000100:00100000:3.0:1788813037.479160:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813037.479173:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322642176:0@lo:103: 00000100:00100000:3.0:1788813037.479187:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813037.479205:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322641792:0@lo:103: 00000100:00100000:3.0:1788813037.479223:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813037.479231:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322642304:0@lo:103: 00000100:00100000:3.0:1788813037.479244:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813037.479253:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813037.479257:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322641920:0@lo:103: 00000100:00100000:3.0:1788813037.479274:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813037.479294:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322641536 00000100:00100000:3.0:1788813037.479299:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322641536 00010000:00010000:3.0:1788813037.479319:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef4214d000/0x1b294f297b1ec192 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec18b expref: 19 pid: 5829 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813037.479334:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322642048 00000100:00100000:3.0:1788813037.479337:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322642048 00010000:00010000:3.0:1788813037.479345:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef21619c00/0x1b294f297b1ec137 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec130 expref: 20 pid: 5828 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813037.479365:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322641664 00000100:00100000:3.0:1788813037.479368:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322641664 00010000:00010000:3.0:1788813037.479378:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef00030600/0x1b294f297b1ec16f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec168 expref: 21 pid: 5828 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813037.479400:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322642176 00000100:00100000:3.0:1788813037.479402:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322642176 00010000:00010000:3.0:1788813037.479412:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef1164f600/0x1b294f297b1ec10d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec106 expref: 22 pid: 5827 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813037.479421:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322641792 00000100:00100000:3.0:1788813037.479423:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322641792 00010000:00010000:3.0:1788813037.479430:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef1164ec00/0x1b294f297b1ec153 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec14c expref: 23 pid: 5829 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813037.479438:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322642304 00000100:00100000:3.0:1788813037.479440:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322642304 00010000:00010000:3.0:1788813037.479447:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef21618400/0x1b294f297b1ec0e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec0dc expref: 24 pid: 5828 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813037.479455:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322641920 00000100:00100000:3.0:1788813037.479457:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322641920 00010000:00010000:3.0:1788813037.479465:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef00031e00/0x1b294f297b1ec145 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec13e expref: 25 pid: 5827 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813037.479476:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788813037.479481:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+25:3301:x1875706322641536:12345-0@lo:103: 00010000:00010000:3.0:1788813037.479491:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813037.479496:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef4214d000/0x1b294f297b1ec192 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec18b expref: 25 pid: 5829 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.479513:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef4214d000/0x1b294f297b1ec192 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ec18b expref: 25 pid: 5829 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.479527:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813037.479556:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+25:3301:x1875706322641536:12345-0@lo:103: Request processed in 75us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813037.479562:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788813037.479576:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788813037.479582:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+24:3301:x1875706322642048:12345-0@lo:103: 00010000:00010000:3.0:1788813037.479588:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813037.479592:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef21619c00/0x1b294f297b1ec137 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec130 expref: 24 pid: 5828 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.479600:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef21619c00/0x1b294f297b1ec137 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ec130 expref: 24 pid: 5828 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.479609:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813037.479629:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+24:3301:x1875706322642048:12345-0@lo:103: Request processed in 48us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813037.479635:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788813037.479648:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788813037.479653:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+23:3301:x1875706322641664:12345-0@lo:103: 00010000:00010000:3.0:1788813037.479660:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813037.479664:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef00030600/0x1b294f297b1ec16f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec168 expref: 23 pid: 5828 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.479671:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef00030600/0x1b294f297b1ec16f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ec168 expref: 23 pid: 5828 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.479685:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813037.479707:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+23:3301:x1875706322641664:12345-0@lo:103: Request processed in 53us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813037.479713:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788813037.479726:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788813037.479731:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+22:3301:x1875706322642176:12345-0@lo:103: 00010000:00010000:3.0:1788813037.479739:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813037.479743:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef1164f600/0x1b294f297b1ec10d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec106 expref: 22 pid: 5827 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.479750:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef1164f600/0x1b294f297b1ec10d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ec106 expref: 22 pid: 5827 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.479759:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813037.479799:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+22:3301:x1875706322642176:12345-0@lo:103: Request processed in 48us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813037.479805:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788813037.479818:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788813037.479824:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+21:3299:x1875706322641792:12345-0@lo:103: 00010000:00010000:3.0:1788813037.479830:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813037.479834:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef1164ec00/0x1b294f297b1ec153 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec14c expref: 21 pid: 5829 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.479842:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef1164ec00/0x1b294f297b1ec153 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ec14c expref: 21 pid: 5829 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.479851:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813037.479884:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+21:3299:x1875706322641792:12345-0@lo:103: Request processed in 61us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813037.479890:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788813037.479903:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788813037.479908:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+20:3299:x1875706322642304:12345-0@lo:103: 00010000:00010000:3.0:1788813037.479915:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813037.479919:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef21618400/0x1b294f297b1ec0e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec0dc expref: 20 pid: 5828 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.479927:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef21618400/0x1b294f297b1ec0e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ec0dc expref: 20 pid: 5828 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.479936:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813037.479957:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+20:3299:x1875706322642304:12345-0@lo:103: Request processed in 49us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813037.479963:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788813037.479975:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788813037.479980:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef121e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3299:x1875706322641920:12345-0@lo:103: 00010000:00010000:3.0:1788813037.479988:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813037.479993:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef00031e00/0x1b294f297b1ec145 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec13e expref: 19 pid: 5827 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.480000:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef00031e00/0x1b294f297b1ec145 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ec13e expref: 19 pid: 5827 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.480009:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813037.480027:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef121e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3299:x1875706322641920:12345-0@lo:103: Request processed in 47us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813037.480033:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788813037.480093:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322641920:0@lo:103: 00000100:00100000:3.0:1788813037.480102:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322641792:0@lo:103: 00000100:00100000:3.0:1788813037.480108:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322642304:0@lo:103: 00000100:00100000:3.0:1788813037.480135:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322641664:0@lo:103: 00000100:00100000:3.0:1788813037.480142:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322642176:0@lo:103: 00000100:00100000:3.0:1788813037.480149:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322641536:0@lo:103: 00000100:00100000:3.0:1788813037.480156:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322642048:0@lo:103: 00010000:00010000:0.0:1788813037.480252:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813037.480377:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef4214d000/0x1b294f297b1ec192 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ec18b expref: 18 pid: 5829 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813037.480400:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b21c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875706322640640:0@lo:104: 00010000:00010000:1.0:1788813037.480410:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef00030600/0x1b294f297b1ec16f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ec168 expref: 17 pid: 5828 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813037.480418:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b22300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875706322640768:0@lo:104: 00010000:00010000:1.0:1788813037.480427:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef1164ec00/0x1b294f297b1ec153 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ec14c expref: 16 pid: 5829 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813037.480434:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b21500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875706322640896:0@lo:104: 00010000:00010000:1.0:1788813037.480454:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef00031e00/0x1b294f297b1ec145 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ec13e expref: 15 pid: 5827 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813037.480462:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b20000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875706322641024:0@lo:104: 00010000:00010000:1.0:1788813037.480471:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef21619c00/0x1b294f297b1ec137 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ec130 expref: 14 pid: 5828 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813037.480478:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b23480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875706322641152:0@lo:104: 00010000:00010000:1.0:1788813037.480485:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef1164f600/0x1b294f297b1ec10d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ec106 expref: 13 pid: 5827 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813037.480493:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b21180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875706322641280:0@lo:104: 00010000:00010000:1.0:1788813037.480501:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef21618400/0x1b294f297b1ec0e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ec0dc expref: 12 pid: 5828 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813037.480508:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b20700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875706322641408:0@lo:104: 00000100:00100000:1.0:1788813037.483484:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b23b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875706322640384:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788813037.483498:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b21880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875706322640512:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788813037.483538:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ef4214c200/0x1b294f297b1ec1e6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813037.485697:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813037.485730:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813037.485760:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307940352 00000100:00100000:3.0:1788813037.485770:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307940352 00010000:00010000:3.0:1788813037.485872:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ec1ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce292d expref: 10 pid: 5828 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813037.485900:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307940480 00000100:00100000:3.0:1788813037.485903:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307940480 00010000:00010000:3.0:1788813037.485916:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef21618000/0x1b294f297b1ec1a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2926 expref: 11 pid: 5828 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813037.485934:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:0.0:1788813037.485940:0:5820:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788813037.485947:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2aa2133f-e434-4510-82b0-9799a685adfa+11:2365:x1875706307940352:12345-192.168.203.13@tcp:103: 00000100:00100000:0.0:1788813037.485955:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788813037.485962:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813037.485970:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ec1ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce292d expref: 11 pid: 5828 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.485983:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ec1ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce292d expref: 11 pid: 5828 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.486018:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ec1ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce292d expref: 11 pid: 5828 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.486034:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813037.486065:0:5819:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788813037.486079:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:2.0:1788813037.486088:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2aa2133f-e434-4510-82b0-9799a685adfa+10:2365:x1875706307940480:12345-192.168.203.13@tcp:103: 00000100:00100000:3.0:1788813037.486096:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2aa2133f-e434-4510-82b0-9799a685adfa+10:2365:x1875706307940352:12345-192.168.203.13@tcp:103: Request processed in 149us (404us total) trans 0 rc 0/0 00010000:00010000:2.0:1788813037.486101:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788813037.486106:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00010000:00010000:2.0:1788813037.486111:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef21618000/0x1b294f297b1ec1a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2926 expref: 10 pid: 5828 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813037.486126:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef21618000/0x1b294f297b1ec1a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2926 expref: 9 pid: 5828 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813037.486138:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef21618000/0x1b294f297b1ec1a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2926 expref: 9 pid: 5828 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813037.486149:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ef4214c200/0x1b294f297b1ec1e6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813037.486166:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef4214c200/0x1b294f297b1ec1e6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813037.486180:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ef4214c200/0x1b294f297b1ec1e6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813037.486187:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ef4214c200/0x1b294f297b1ec1e6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813037.486194:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ef4214c200/0x1b294f297b1ec1e6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813037.486201:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ef4214c200/0x1b294f297b1ec1e6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813037.486206:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214c200 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:2.0:1788813037.486211:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ef4214c200/0x1b294f297b1ec1e6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813037.486219:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ef4214c200/0x1b294f297b1ec1e6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813037.486243:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ef4214c200/0x1b294f297b1ec1e6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813037.486253:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813037.486275:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2aa2133f-e434-4510-82b0-9799a685adfa+8:2365:x1875706307940480:12345-192.168.203.13@tcp:103: Request processed in 189us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813037.486281:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00010000:00010000:3.0:1788813037.486299:0:8434:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ef4214c200/0x1b294f297b1ec1e6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.486309:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ef4214c200/0x1b294f297b1ec1e6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.486316:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef4214c200/0x1b294f297b1ec1e6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813037.660947:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813037.725121:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1875706322642688:0@lo:400: 00000100:00100000:1.0:1788813037.725121:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322642816:0@lo:400: 00000100:00100000:0.0:1788813037.725227:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322642432:0@lo:400: 00000100:00100000:2.0:1788813037.725419:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322642560:0@lo:400: 00000100:00100000:3.0:1788813037.725492:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813037.725562:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322642688 00000100:00100000:3.0:1788813037.725569:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322642688 00000100:00100000:3.0:1788813037.725621:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788813037.725631:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875706322642688:12345-0@lo:400: 00000100:00100000:3.0:1788813037.725680:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875706322642688:12345-0@lo:400: Request processed in 51us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813037.725686:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788813037.725707:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813037.725743:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1875706322642688:0@lo:400: 00000100:00100000:3.0:1788813037.725951:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322643200:0@lo:13: 00000100:00100000:3.0:1788813037.725980:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813037.726636:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813037.726686:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322643200 00000100:00100000:1.0:1788813037.726691:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322643200 00000100:00100000:1.0:1788813037.726736:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788813037.726743:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322643200:12345-0@lo:13: 00002000:00000024:1.0:1788813037.726772:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813037.726827:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322643200:12345-0@lo:13: Request processed in 84us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813037.726833:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788813037.726851:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788813037.726872:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef354c5180 x1875706322643200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813037.726887:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322643200:0@lo:13: 00000100:00100000:0.0:1788813037.726984:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813037.727018:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1875706322642944:0@lo:400: 00000100:00100000:0.0:1788813037.727042:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813037.727070:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322642944 00000100:00100000:0.0:1788813037.727073:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322642944 00000100:00100000:0.0:1788813037.727098:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788813037.727104:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875706322642944:12345-0@lo:400: 00000100:00100000:0.0:1788813037.727137:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875706322642944:12345-0@lo:400: Request processed in 33us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813037.727143:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788813037.727167:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1875706322642944:0@lo:400: 00000100:00100000:1.0:1788813037.727239:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322642432 00000100:00100000:1.0:1788813037.727243:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322642432 00000100:00100000:1.0:1788813037.727272:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788813037.727278:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21385050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:3300:x1875706322642432:12345-0@lo:400: 00000100:00100000:1.0:1788813037.727313:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21385050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:3300:x1875706322642432:12345-0@lo:400: Request processed in 35us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813037.727318:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:1.0:1788813037.727340:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813037.727354:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322642432:0@lo:400: 00000100:00100000:3.0:1788813037.727514:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322642816 00000100:00100000:3.0:1788813037.727519:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322642816 00000100:00100000:2.0:1788813037.727524:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813037.727547:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788813037.727552:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322642816:12345-0@lo:400: 00010000:00080000:1.0:1788813037.727645:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef354c6300 x1875706322642816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813037.727654:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322642816:0@lo:400: 00000100:00100000:3.0:1788813037.728515:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322642816:12345-0@lo:400: Request processed in 959us (1878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813037.728523:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788813037.728527:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322643072:0@lo:400: 00000100:00100000:3.0:1788813037.728547:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322642560 00000100:00100000:3.0:1788813037.728552:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322642560 00000100:00100000:2.0:1788813037.728626:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813037.728632:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788813037.728640:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322642560:12345-0@lo:400: 00000100:00100000:3.0:1788813037.728692:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322642560:12345-0@lo:400: Request processed in 52us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813037.728699:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788813037.728755:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322643072 00000100:00100000:1.0:1788813037.728760:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322643072 00000100:00080000:0.0:1788813037.728798:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813037.728813:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788813037.728819:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322643072:12345-0@lo:400: 00000100:00100000:1.0:1788813037.728855:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322643072:12345-0@lo:400: Request processed in 37us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813037.728859:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788813037.728894:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322642560:0@lo:400: 00010000:00080000:1.0:1788813037.728906:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef354c5500 x1875706322643072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813037.728915:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322643072:0@lo:400: 00000100:00100000:3.0:1788813038.237101:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322643328:0@lo:13: 00000100:00100000:3.0:1788813038.237173:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813038.237404:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322643328 00000100:00100000:1.0:1788813038.237412:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322643328 00000100:00100000:1.0:1788813038.237464:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788813038.237473:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322643328:12345-0@lo:13: 00002000:00000024:1.0:1788813038.237505:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813038.237561:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322643328:12345-0@lo:13: Request processed in 89us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813038.237568:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788813038.237710:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef36b21180 x1875706322643328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813038.237728:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322643328:0@lo:13: 00010000:00010000:0.0:1788813038.685445:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788813038.812937:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788813038.812944:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93ee0532b000 from 39 10000000:01000000:1.0:1788813038.812950:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788813038.812998:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214c000/0x1b294f297b1ec1ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813038.813010:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef4214c000/0x1b294f297b1ec1ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813038.813022:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef4214c000/0x1b294f297b1ec1ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813038.813047:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322643456:0@lo:101: 00000100:00100000:1.0:1788813038.813135:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813038.813218:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef19c80840 going to sleep for 11 seconds 00000100:00100000:3.0:1788813038.813383:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322643456 00000100:00100000:3.0:1788813038.813391:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322643456 00000100:00100000:3.0:1788813038.813447:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788813038.813457:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+12:5831:x1875706322643456:12345-0@lo:101: 00010000:00010000:3.0:1788813038.813470:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813038.813490:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef1164e800/0x1b294f297b1ec1f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec1ed expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813038.813512:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef1164e800/0x1b294f297b1ec1f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec1ed expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813038.813522:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef1164e800/0x1b294f297b1ec1f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec1ed expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813038.813530:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164e800, rc 0) 00000100:00100000:3.0:1788813038.813577:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:5831:x1875706322643456:12345-0@lo:101: Request processed in 121us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813038.813583:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788813038.813679:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322643456:0@lo:101: 00010000:00010000:2.0:1788813038.813694:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef4214c000/0x1b294f297b1ec1ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec1f4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813038.813702:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef4214c000/0x1b294f297b1ec1ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec1f4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813038.813751:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322643584:0@lo:501: 00000100:00100000:2.0:1788813038.813777:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813038.813830:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a1f4300 going to sleep for 11 seconds 00000100:00100000:1.0:1788813038.813896:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322643584 00000100:00100000:1.0:1788813038.813901:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322643584 00000100:00100000:1.0:1788813038.813934:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788813038.813941:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21387050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:5831:x1875706322643584:12345-0@lo:501: 00000100:00100000:1.0:1788813038.814322:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21387050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:5831:x1875706322643584:12345-0@lo:501: Request processed in 380us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813038.814331:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788813038.815686:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322643584:0@lo:501: 00000100:00100000:2.0:1788813038.815741:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322643712:0@lo:503: 00000100:00100000:2.0:1788813038.815816:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813038.815913:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a1f4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788813038.816093:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322643712 00000100:00100000:0.0:1788813038.816100:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322643712 00000100:00100000:0.0:1788813038.816444:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788813038.816455:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21387450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:5831:x1875706322643712:12345-0@lo:503: 00000100:00100000:0.0:1788813038.817907:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21387450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:5831:x1875706322643712:12345-0@lo:503: Request processed in 1448us (2084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813038.817920:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788813038.819819:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322643712:0@lo:503: 00000100:00100000:2.0:1788813038.820228:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8451:1875706322643840:0@lo:502: 00000100:00100000:2.0:1788813038.820317:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813038.820467:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a1f4840 going to sleep for 11 seconds 00000100:00100000:0.0:1788813038.820697:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322643840 00000100:00100000:0.0:1788813038.820705:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322643840 00000100:00100000:0.0:1788813038.820754:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788813038.820763:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:8451:x1875706322643840:12345-0@lo:502: 00000100:00100000:0.0:1788813038.821022:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:8451:x1875706322643840:12345-0@lo:502: Request processed in 261us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813038.821030:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788813038.821124:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8451:1875706322643840:0@lo:502: 00000100:00100000:2.0:1788813038.821172:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8451:1875706322643968:0@lo:502: 00000100:00100000:2.0:1788813038.821207:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813038.821239:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a1f4840 going to sleep for 11 seconds 00000100:00100000:0.0:1788813038.821802:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322643968 00000100:00100000:0.0:1788813038.821808:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322643968 00000100:00100000:0.0:1788813038.821836:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788813038.821843:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:8451:x1875706322643968:12345-0@lo:502: 00000100:00100000:0.0:1788813038.822029:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:8451:x1875706322643968:12345-0@lo:502: Request processed in 185us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813038.822036:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788813038.822184:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8451:1875706322643968:0@lo:502: 00000040:00080000:2.0:1788813038.822209:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788813038.822817:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788813038.822841:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788813038.822852:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214c000/0x1b294f297b1ec1ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec1f4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813038.822863:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef4214c000/0x1b294f297b1ec1ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec1f4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813038.822874:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788813038.822876:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788813038.822879:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788813038.822908:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec1fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813038.822916:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec1fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813038.822925:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec1fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813038.822950:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322644096:0@lo:101: 00000100:00100000:3.0:1788813038.822989:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813038.823029:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1219fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788813038.825041:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322644096 00000100:00100000:0.0:1788813038.825054:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322644096 00000100:00100000:0.0:1788813038.825109:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788813038.825119:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+13:5831:x1875706322644096:12345-0@lo:101: 00010000:00010000:0.0:1788813038.825135:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813038.825155:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef00031800/0x1b294f297b1ec202 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec1fb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813038.825185:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef00031800/0x1b294f297b1ec202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec1fb expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813038.825196:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef00031800/0x1b294f297b1ec202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec1fb expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813038.825205:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef00031800, rc 0) 00000100:00100000:0.0:1788813038.825282:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:5831:x1875706322644096:12345-0@lo:101: Request processed in 164us (2292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813038.825289:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788813038.825601:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322644096:0@lo:101: 00010000:00010000:2.0:1788813038.825619:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec1fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec202 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813038.825629:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec1fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec202 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813038.825695:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322644224:0@lo:501: 00000100:00100000:2.0:1788813038.825730:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813038.825754:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a1f4840 going to sleep for 11 seconds 00000100:00100000:1.0:1788813038.825970:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322644224 00000100:00100000:1.0:1788813038.825976:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322644224 00000100:00100000:1.0:1788813038.826077:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788813038.826086:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:5831:x1875706322644224:12345-0@lo:501: 00000100:00100000:1.0:1788813038.826349:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:5831:x1875706322644224:12345-0@lo:501: Request processed in 264us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813038.826356:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788813038.826478:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322644224:0@lo:501: 00000100:00100000:2.0:1788813038.826512:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322644352:0@lo:503: 00000100:00100000:2.0:1788813038.826551:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813038.828939:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a1f4840 going to sleep for 11 seconds 00000100:00100000:3.0:1788813038.829029:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322644352 00000100:00100000:3.0:1788813038.829039:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322644352 00000100:00100000:3.0:1788813038.829086:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788813038.829096:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:5831:x1875706322644352:12345-0@lo:503: 00000100:00100000:3.0:1788813038.829338:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:5831:x1875706322644352:12345-0@lo:503: Request processed in 243us (2785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813038.829345:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788813038.829436:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322644352:0@lo:503: 00000100:00100000:1.0:1788813038.831617:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8452:1875706322644480:0@lo:502: 00000100:00100000:1.0:1788813038.831691:0:8452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813038.831739:0:8452:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef19c80480 going to sleep for 11 seconds 00000100:00100000:0.0:1788813038.831856:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322644480 00000100:00100000:0.0:1788813038.831865:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322644480 00000100:00100000:0.0:1788813038.831916:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788813038.831925:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:8452:x1875706322644480:12345-0@lo:502: 00000100:00100000:0.0:1788813038.832136:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:8452:x1875706322644480:12345-0@lo:502: Request processed in 212us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813038.832144:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788813038.832244:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8452:1875706322644480:0@lo:502: 00000020:01000000:1.0:1788813038.832270:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813038.832278:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813038.832281:0:8452:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788813038.832285:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788813038.832308:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8452:1875706322644608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813038.832342:0:8452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813038.832387:0:8452:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef19c80480 going to sleep for 11 seconds 00000100:00100000:2.0:1788813038.832589:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322644608 00000100:00100000:2.0:1788813038.832595:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322644608 00000100:00100000:2.0:1788813038.832634:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788813038.832643:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:8452:x1875706322644608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813038.832813:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:8452:x1875706322644608:12345-0@lo:502:llog_process_th.0 Request processed in 139us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813038.832822:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788813038.832831:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8452:1875706322644608:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788813038.832856:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813038.832862:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813038.832864:0:8452:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788813038.832868:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788813038.833021:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788813038.833043:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788813038.833054:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec1fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec202 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813038.833065:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec1fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec202 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813038.833075:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788813038.833077:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93ef197e7800 from 39 10000000:01000000:0.0:1788813038.833080:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788813038.833104:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef00031e00/0x1b294f297b1ec209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813038.833112:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef00031e00/0x1b294f297b1ec209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813038.833121:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef00031e00/0x1b294f297b1ec209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813038.833137:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ef5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322644736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788813038.833174:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813038.833284:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee066bb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813038.834052:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322644736 00000100:00100000:2.0:1788813038.834060:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322644736 00000100:00100000:2.0:1788813038.834102:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788813038.834109:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:5831:x1875706322644736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813038.834120:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813038.834134:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef21618e00/0x1b294f297b1ec210 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec209 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813038.834158:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef21618e00/0x1b294f297b1ec210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec209 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813038.834169:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef21618e00/0x1b294f297b1ec210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec209 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813038.834177:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21618e00, rc 0) 00000100:00100000:2.0:1788813038.834225:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:5831:x1875706322644736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813038.834231:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788813038.836340:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ef5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322644736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813038.836383:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef00031e00/0x1b294f297b1ec209 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec210 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813038.836397:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef00031e00/0x1b294f297b1ec209 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec210 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813038.836478:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322644864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813038.836531:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813038.836586:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef19c80480 going to sleep for 11 seconds 00000100:00100000:0.0:1788813038.836597:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322644864 00000100:00100000:0.0:1788813038.836604:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322644864 00000100:00100000:0.0:1788813038.836650:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788813038.836659:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:5831:x1875706322644864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813038.836951:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:5831:x1875706322644864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 293us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813038.836960:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788813038.836984:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322644864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813038.837016:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322644992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813038.837059:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813038.837087:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef19c80480 going to sleep for 11 seconds 00000100:00100000:0.0:1788813038.837146:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322644992 00000100:00100000:0.0:1788813038.837151:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322644992 00000100:00100000:0.0:1788813038.837174:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788813038.837180:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:5831:x1875706322644992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813038.837326:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:5831:x1875706322644992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813038.837333:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788813038.837416:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322644992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813038.837816:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8453:1875706322645120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813038.837856:0:8453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813038.837876:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef19c80a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813038.837924:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322645120 00000100:00100000:0.0:1788813038.837929:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322645120 00000100:00100000:0.0:1788813038.837957:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788813038.837964:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:8453:x1875706322645120:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813038.838116:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:8453:x1875706322645120:12345-0@lo:502:llog_process_th.0 Request processed in 152us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813038.838123:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788813038.838205:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8453:1875706322645120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813038.838244:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8453:1875706322645248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813038.838283:0:8453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813038.838311:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef19c80a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813038.838362:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322645248 00000100:00100000:0.0:1788813038.838367:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322645248 00000100:00100000:0.0:1788813038.838408:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788813038.838417:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:8453:x1875706322645248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813038.838555:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:8453:x1875706322645248:12345-0@lo:502:llog_process_th.0 Request processed in 139us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813038.838562:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788813038.838824:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8453:1875706322645248:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788813038.838848:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788813038.838980:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788813038.838996:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788813038.839005:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef00031e00/0x1b294f297b1ec209 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec210 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813038.839016:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef00031e00/0x1b294f297b1ec209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec210 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813038.839026:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788813038.839028:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788813038.839031:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788813038.839056:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef00030600/0x1b294f297b1ec217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813038.839064:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef00030600/0x1b294f297b1ec217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813038.839073:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef00030600/0x1b294f297b1ec217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813038.839086:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ef5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322645376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788813038.839115:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813038.839175:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee066bb300 going to sleep for 11 seconds 00000100:00100000:1.0:1788813038.839755:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322645376 00000100:00100000:1.0:1788813038.839761:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322645376 00000100:00100000:1.0:1788813038.839897:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788813038.839905:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:5831:x1875706322645376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813038.839915:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813038.839926:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef4214ca00/0x1b294f297b1ec21e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec217 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813038.839946:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef4214ca00/0x1b294f297b1ec21e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec217 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813038.839956:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef4214ca00/0x1b294f297b1ec21e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec217 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813038.839964:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef4214ca00, rc 0) 00000100:00100000:1.0:1788813038.840013:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:5831:x1875706322645376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813038.840020:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788813038.840096:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ef5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322645376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813038.840110:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef00030600/0x1b294f297b1ec217 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec21e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813038.840119:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef00030600/0x1b294f297b1ec217 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec21e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813038.840167:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322645504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813038.840201:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813038.840281:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1219f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813038.840463:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322645504 00000100:00100000:0.0:1788813038.840468:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322645504 00000100:00100000:0.0:1788813038.840490:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788813038.840508:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:5831:x1875706322645504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813038.840934:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:5831:x1875706322645504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 426us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813038.840942:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788813038.841024:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322645504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813038.841055:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322645632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813038.841092:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813038.841121:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1219f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813038.841212:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322645632 00000100:00100000:0.0:1788813038.841217:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322645632 00000100:00100000:0.0:1788813038.841248:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788813038.841255:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:5831:x1875706322645632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813038.841390:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:5831:x1875706322645632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813038.841397:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788813038.841477:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322645632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813038.842153:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8454:1875706322645760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813038.842194:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813038.842222:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1219fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813038.842273:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322645760 00000100:00100000:0.0:1788813038.842278:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322645760 00000100:00100000:0.0:1788813038.842310:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788813038.842317:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:8454:x1875706322645760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813038.842479:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:8454:x1875706322645760:12345-0@lo:502:llog_process_th.0 Request processed in 162us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813038.842487:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788813038.842574:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8454:1875706322645760:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788813038.842597:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813038.842615:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813038.842618:0:8454:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788813038.842623:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788813038.842642:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b21500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8454:1875706322645888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813038.842673:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813038.842696:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef19c806c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813038.842817:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322645888 00000100:00100000:0.0:1788813038.842822:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322645888 00000100:00100000:0.0:1788813038.842851:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788813038.842860:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:8454:x1875706322645888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813038.842986:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:8454:x1875706322645888:12345-0@lo:502:llog_process_th.0 Request processed in 128us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813038.842993:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788813038.843076:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b21500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8454:1875706322645888:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788813038.843098:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813038.843102:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813038.843104:0:8454:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788813038.843109:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1788813038.843187:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788813038.843215:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788813038.843224:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef00030600/0x1b294f297b1ec217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec21e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813038.843233:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef00030600/0x1b294f297b1ec217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec21e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813038.843243:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788813038.843245:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93ef2171d800 from 39 10000000:01000000:0.0:1788813038.843248:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788813038.843269:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813038.843276:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813038.843284:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813038.843295:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322646016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788813038.843322:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813038.843355:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee066bb000 going to sleep for 11 seconds 00000100:00100000:2.0:1788813038.843388:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322646016 00000100:00100000:2.0:1788813038.843393:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322646016 00000100:00100000:2.0:1788813038.843427:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788813038.843433:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:5831:x1875706322646016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813038.843442:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813038.843459:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef21619800/0x1b294f297b1ec22c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec225 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813038.843542:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef21619800/0x1b294f297b1ec22c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec225 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813038.843554:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef21619800/0x1b294f297b1ec22c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec225 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813038.843562:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619800, rc 0) 00000100:00100000:2.0:1788813038.843601:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322646016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813038.843607:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788813038.843642:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322646016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813038.843655:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec225 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec22c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813038.843664:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec225 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec22c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813038.843705:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322646144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813038.843740:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813038.843761:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee066bb000 going to sleep for 11 seconds 00000100:00100000:1.0:1788813038.843893:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322646144 00000100:00100000:1.0:1788813038.843898:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322646144 00000100:00100000:1.0:1788813038.843931:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788813038.843938:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322646144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813038.844149:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322646144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 210us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813038.844156:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788813038.844303:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322646144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813038.844331:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322646272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813038.844367:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813038.844404:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee066bb000 going to sleep for 11 seconds 00000100:00100000:2.0:1788813038.844549:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322646272 00000100:00100000:2.0:1788813038.844555:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322646272 00000100:00100000:2.0:1788813038.844587:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788813038.844595:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322646272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813038.844744:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322646272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813038.844752:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788813038.844828:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322646272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813038.845193:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ef4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8455:1875706322646400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813038.845228:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813038.845254:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef21238480 going to sleep for 11 seconds 00000100:00100000:3.0:1788813038.845308:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322646400 00000100:00100000:3.0:1788813038.845312:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322646400 00000100:00100000:3.0:1788813038.845340:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788813038.845347:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:8455:x1875706322646400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813038.845535:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:8455:x1875706322646400:12345-0@lo:502:llog_process_th.0 Request processed in 188us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813038.845542:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788813038.845638:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ef4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8455:1875706322646400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813038.845670:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ef4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8455:1875706322646528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813038.845693:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813038.845710:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef21238480 going to sleep for 11 seconds 00000100:00100000:2.0:1788813038.845843:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322646528 00000100:00100000:2.0:1788813038.845848:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322646528 00000100:00100000:2.0:1788813038.845882:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788813038.845890:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:8455:x1875706322646528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813038.846143:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:8455:x1875706322646528:12345-0@lo:502:llog_process_th.0 Request processed in 253us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813038.846150:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788813038.849824:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ef4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8455:1875706322646528:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788813038.849878:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788813038.850101:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788813038.850120:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788813038.850132:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec225 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec22c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813038.850144:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec22c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813038.850154:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788813038.850157:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788813038.850159:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788813038.850197:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec233 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813038.850205:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec233 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813038.850230:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec233 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813038.850251:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322646656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788813038.850311:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813038.850354:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1219fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813038.850422:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322646656 00000100:00100000:1.0:1788813038.850429:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322646656 00000100:00100000:1.0:1788813038.850477:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788813038.850486:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322646656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813038.850498:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813038.850511:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef4214de00/0x1b294f297b1ec23a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec233 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813038.850532:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef4214de00/0x1b294f297b1ec23a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec233 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813038.850542:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef4214de00/0x1b294f297b1ec23a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec233 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813038.850550:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef4214de00, rc 0) 00000100:00100000:1.0:1788813038.850595:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322646656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813038.850602:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788813038.850776:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322646656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813038.850840:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec233 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec23a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813038.850850:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec233 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec23a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813038.850902:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322646784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813038.850940:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813038.850968:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef21238480 going to sleep for 11 seconds 00000100:00100000:2.0:1788813038.850977:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322646784 00000100:00100000:2.0:1788813038.850990:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322646784 00000100:00100000:2.0:1788813038.851032:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788813038.851041:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322646784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813038.851314:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322646784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 274us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813038.851321:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788813038.851389:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322646784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813038.851416:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322646912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813038.851456:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813038.851518:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef21238480 going to sleep for 11 seconds 00000100:00100000:3.0:1788813038.852204:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322646912 00000100:00100000:3.0:1788813038.852211:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322646912 00000100:00100000:3.0:1788813038.852281:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788813038.852290:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322646912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813038.852489:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322646912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813038.852496:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788813038.852584:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322646912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813038.853077:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ef4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8456:1875706322647040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813038.853121:0:8456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813038.853276:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef212383c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813038.853343:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322647040 00000100:00100000:1.0:1788813038.853349:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322647040 00000100:00100000:1.0:1788813038.853386:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788813038.853393:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:8456:x1875706322647040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813038.853614:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:8456:x1875706322647040:12345-0@lo:502:llog_process_th.0 Request processed in 212us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813038.853622:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788813038.853843:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ef4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8456:1875706322647040:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788813038.853868:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813038.853877:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813038.853879:0:8456:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788813038.853887:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788813038.853909:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ef4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8456:1875706322647168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813038.853945:0:8456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813038.853963:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef212383c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813038.854006:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322647168 00000100:00100000:3.0:1788813038.854011:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322647168 00000100:00100000:3.0:1788813038.854033:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788813038.854040:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:8456:x1875706322647168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813038.854228:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:8456:x1875706322647168:12345-0@lo:502:llog_process_th.0 Request processed in 187us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813038.854235:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788813038.854464:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ef4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8456:1875706322647168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788813038.854485:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813038.854489:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813038.854491:0:8456:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788813038.854495:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788813038.858046:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1788813038.858085:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788813038.858098:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec233 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec23a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813038.858112:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec233 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec23a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813038.858139:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788813038.858143:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93ef2a35b380 from 1 10000000:01000000:2.0:1788813038.858146:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788813038.858188:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef21619600/0x1b294f297b1ec241 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813038.858197:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef21619600/0x1b294f297b1ec241 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813038.858209:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef21619600/0x1b294f297b1ec241 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813038.858232:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322647296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788813038.858298:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813038.858393:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a1f4240 going to sleep for 11 seconds 00000100:00100000:3.0:1788813038.858497:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322647296 00000100:00100000:3.0:1788813038.858505:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322647296 00000100:00100000:3.0:1788813038.858723:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788813038.858734:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322647296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813038.858747:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813038.858766:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef1164fa00/0x1b294f297b1ec248 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec241 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813038.858904:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef1164fa00/0x1b294f297b1ec248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec241 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813038.858914:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef1164fa00/0x1b294f297b1ec248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec241 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813038.858922:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164fa00, rc 0) 00000100:00100000:3.0:1788813038.859006:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:5831:x1875706322647296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 274us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813038.859013:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788813038.859157:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322647296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813038.859173:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef21619600/0x1b294f297b1ec241 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec248 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813038.859182:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef21619600/0x1b294f297b1ec241 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec248 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813038.859237:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322647424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813038.859267:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813038.859331:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a1f4240 going to sleep for 11 seconds 00000100:00100000:3.0:1788813038.859362:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322647424 00000100:00100000:3.0:1788813038.859367:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322647424 00000100:00100000:3.0:1788813038.859438:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788813038.859446:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:5831:x1875706322647424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813038.859848:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:5831:x1875706322647424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 402us (579us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788813038.859855:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788813038.859985:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322647424:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788813038.860011:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788813038.860017:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef21619600/0x1b294f297b1ec241 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec248 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813038.860025:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef21619600/0x1b294f297b1ec241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec248 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813039.709036:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813040.334243:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813040.335870:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307940608 00000100:00100000:1.0:1788813040.335889:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307940608 00000100:00100000:1.0:1788813040.335982:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 161 00000100:00100000:1.0:1788813040.335994:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+8:5600:x1875706307940608:12345-192.168.203.13@tcp:101: 00010000:00010000:1.0:1788813040.336015:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813040.336038:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef4214c200/0x1b294f297b1ec24f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x78c59908dfce298f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813040.336074:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef4214c200/0x1b294f297b1ec24f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce298f expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813040.336087:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef4214c200/0x1b294f297b1ec24f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce298f expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813040.336097:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef4214c200, rc 0) 00000100:00100000:1.0:1788813040.336324:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+9:5600:x1875706307940608:12345-192.168.203.13@tcp:101: Request processed in 331us (2088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813040.336332:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 161 00000100:00100000:0.0:1788813040.342329:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813040.342427:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307940736 00000100:00100000:2.0:1788813040.342442:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307940736 00000100:00100000:2.0:1788813040.342509:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 162 00000100:00100000:2.0:1788813040.342520:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+9:5600:x1875706307940736:12345-192.168.203.13@tcp:501: 00000100:00100000:2.0:1788813040.342840:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+9:5600:x1875706307940736:12345-192.168.203.13@tcp:501: Request processed in 322us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813040.342848:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 162 00000100:00100000:0.0:1788813040.344468:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813040.344679:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307940864 00000100:00100000:1.0:1788813040.344691:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307940864 00000100:00100000:1.0:1788813040.345048:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 163 00000100:00100000:1.0:1788813040.345066:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+9:5600:x1875706307940864:12345-192.168.203.13@tcp:503: 00000100:00100000:1.0:1788813040.345340:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+9:5600:x1875706307940864:12345-192.168.203.13@tcp:503: Request processed in 283us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813040.345358:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 163 00000100:00100000:3.0:1788813040.356869:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813040.357088:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307940992 00000100:00100000:2.0:1788813040.357101:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307940992 00000100:00100000:2.0:1788813040.357233:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 164 00000100:00100000:2.0:1788813040.357243:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+9:6078:x1875706307940992:12345-192.168.203.13@tcp:502: 00000100:00100000:2.0:1788813040.357544:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+9:6078:x1875706307940992:12345-192.168.203.13@tcp:502: Request processed in 301us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813040.357552:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 164 00000100:00100000:0.0:1788813040.362552:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813040.362943:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307941120 00000100:00100000:1.0:1788813040.362957:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307941120 00000100:00100000:1.0:1788813040.363095:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 165 00000100:00100000:1.0:1788813040.363107:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+9:6078:x1875706307941120:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788813040.363551:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+9:6078:x1875706307941120:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 445us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813040.363560:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 165 00000100:00100000:1.0:1788813040.368534:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813040.368845:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307941248 00000100:00100000:2.0:1788813040.368859:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307941248 00000100:00100000:2.0:1788813040.368926:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 166 00000100:00100000:2.0:1788813040.368937:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+9:5600:x1875706307941248:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813040.368957:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813040.368981:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef21619400/0x1b294f297b1ec256 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2996 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813040.369018:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef21619400/0x1b294f297b1ec256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2996 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813040.369030:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef21619400/0x1b294f297b1ec256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2996 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813040.369040:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619400, rc 0) 00000100:00100000:2.0:1788813040.369122:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+10:5600:x1875706307941248:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 187us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813040.369131:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 166 00000100:00100000:0.0:1788813040.373448:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813040.373669:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307941376 00000100:00100000:1.0:1788813040.373682:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307941376 00000100:00100000:1.0:1788813040.373754:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 167 00000100:00100000:1.0:1788813040.373763:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+10:5600:x1875706307941376:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813040.374108:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+10:5600:x1875706307941376:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 346us (674us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788813040.374116:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 167 00000100:00100000:0.0:1788813040.589067:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813040.589121:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813040.589203:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307941632 00000100:00100000:1.0:1788813040.589217:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307941632 00000100:00100000:0.0:1788813040.589218:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813040.589308:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307941504 00000100:00100000:2.0:1788813040.589313:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307941504 00000100:00100000:3.0:1788813040.589377:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307941760 00000100:00100000:3.0:1788813040.589381:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307941760 00000100:00100000:1.0:1788813040.589435:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:1.0:1788813040.589457:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+5:2364:x1875706307941632:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813040.589916:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+5:2364:x1875706307941632:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 468us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813040.589926:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:2.0:1788813040.592492:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:2.0:1788813040.592512:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2364:x1875706307941504:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813040.592646:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2364:x1875706307941504:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 141us (3592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813040.592656:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00080000:0.0:1788813040.594534:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788813040.594550:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788813040.594554:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813040.596101:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1788813040.596119:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+5:2363:x1875706307941760:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813040.596242:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+5:2363:x1875706307941760:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 130us (7024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813040.596265:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00010000:00010000:0.0:1788813040.734336:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788813041.575482:0:8497:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc0dda0a90 20000000:00000080:0.0:1788813041.575505:0:8497:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93ef3690d000 uarg=0000000000000000 20000000:01000000:0.0:1788813041.575557:0:8497:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788813041.575564:0:8497:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788813041.575570:0:8497:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788813041.579774:0:8498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788813041.580416:0:8497:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788813041.586300:0:8497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788813041.586387:0:8497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788813041.586450:0:8497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788813041.586472:0:8497:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788813041.586500:0:8497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ec25d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813041.586520:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef01517200/0x1b294f297b1ebfd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ebfcb expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813041.586528:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef1164f800/0x1b294f297b1ec034 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec02d expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813041.586534:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef21618200/0x1b294f297b1ec0ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec0f8 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813041.586545:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef1164ee00/0x1b294f297b1ec1bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce295e expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813041.586552:0:8497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ec25d lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813041.586600:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef1164ee00/0x1b294f297b1ec1bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce295e expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813041.586616:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ef1164ee00/0x1b294f297b1ec1bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce295e expref: 9 pid: 5827 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813041.586632:0:8497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b22300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875706322647552:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788813041.586773:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef21618200/0x1b294f297b1ec0ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ec0f8 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813041.586829:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ef21618200/0x1b294f297b1ec0ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ec0f8 expref: 18 pid: 5828 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813041.586848:0:8497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b21c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875706322647680:0@lo:104: 00000100:00100000:1.0:1788813041.586898:0:8497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813041.587302:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322647680 00000100:00100000:3.0:1788813041.587312:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322647680 00000100:00100000:3.0:1788813041.587456:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788813041.587468:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:8497:x1875706322647680:12345-0@lo:104: 00010000:00010000:3.0:1788813041.587484:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef00031c00/0x1b294f297b1ec0f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec0ff expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813041.587554:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788813041.587560:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:8497:x1875706322647680:12345-0@lo:104: Request processed in 95us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813041.587568:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1788813041.587630:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813041.587639:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef00031c00/0x1b294f297b1ec0f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec0ff expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813041.587648:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef00031c00 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:0.0:1788813041.587653:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef00031c00/0x1b294f297b1ec0f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ec0ff expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813041.587662:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef00031c00/0x1b294f297b1ec0f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ec0ff expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813041.587671:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef00031c00/0x1b294f297b1ec0f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ec0ff expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813041.587678:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788813041.587728:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef00031c00/0x1b294f297b1ec0f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec0ff expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813041.587736:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813041.587759:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef00031c00/0x1b294f297b1ec0f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec0ff expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813041.587766:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef00031c00/0x1b294f297b1ec0f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec0ff expref: -99 pid: 7615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813041.587800:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813041.587803:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813041.587805:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813041.587818:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322647936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813041.587856:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813041.587952:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322647936 00000100:00100000:3.0:1788813041.588045:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322647936 00010000:00010000:3.0:1788813041.588070:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef21618200/0x1b294f297b1ec0ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec0f8 expref: 19 pid: 5828 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813041.588103:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788813041.588110:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3300:x1875706322647936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788813041.588122:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813041.588128:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef21618200/0x1b294f297b1ec0ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec0f8 expref: 19 pid: 5828 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813041.588232:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef1164f800/0x1b294f297b1ec034 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ec02d expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813041.588247:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ef1164f800/0x1b294f297b1ec034 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ec02d expref: 19 pid: 5829 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813041.588258:0:8497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b23100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875706322647808:0@lo:104: 00000100:00100000:1.0:1788813041.588304:0:8497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813041.588389:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788813041.588403:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322647808 00000100:00100000:0.0:1788813041.588406:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322647808 00000100:00100000:0.0:1788813041.588441:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788813041.588447:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06e00450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:8497:x1875706322647808:12345-0@lo:104: 00010000:00010000:0.0:1788813041.588457:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ec02d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec034 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813041.588499:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788813041.588504:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06e00450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:8497:x1875706322647808:12345-0@lo:104: Request processed in 58us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813041.588510:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1788813041.588560:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813041.588565:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ec02d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec034 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813041.588585:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619200 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:0.0:1788813041.588590:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ec02d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ec034 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813041.588598:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ec02d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ec034 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813041.588604:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ec02d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ec034 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813041.588609:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788813041.588637:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ec02d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec034 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813041.588644:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813041.588667:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ec02d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec034 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813041.588673:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ec02d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec034 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813041.588686:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813041.588688:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813041.588690:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813041.589194:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322648064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813041.589236:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813041.589602:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef21618200/0x1b294f297b1ec0ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ec0f8 expref: 19 pid: 5828 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813041.589630:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813041.589642:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322648064 00000100:00100000:1.0:1788813041.589650:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322648064 00010000:00010000:1.0:1788813041.589679:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef1164f800/0x1b294f297b1ec034 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec02d expref: 20 pid: 5829 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813041.589700:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+20:3300:x1875706322647936:12345-0@lo:103:ldlm_bl.0 Request processed in 1589us (1842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813041.589710:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788813041.589739:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788813041.589749:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3301:x1875706322648064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788813041.589762:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788813041.589763:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322647936:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788813041.589771:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef1164f800/0x1b294f297b1ec034 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec02d expref: 19 pid: 5829 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813041.589806:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef1164f800/0x1b294f297b1ec034 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ec02d expref: 19 pid: 5829 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813041.589817:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813041.589860:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3301:x1875706322648064:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813041.589868:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1788813041.589873:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef01517200/0x1b294f297b1ebfd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ebfcb expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813041.589886:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ef01517200/0x1b294f297b1ebfd2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ebfcb expref: 18 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813041.589897:0:8497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b23800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875706322648192:0@lo:104: 00000100:00100000:1.0:1788813041.589929:0:8497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813041.590055:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322648064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813041.590120:0:8497:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2259ad80 going to sleep for 11 seconds 00010000:00010000:1.0:1788813041.590136:0:8497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef21618200/0x1b294f297b1ec0ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ec0f8 expref: 18 pid: 5828 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813041.590148:0:8497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b21c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875706322647680:0@lo:104: 00010000:00010000:1.0:1788813041.590158:0:8497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef1164f800/0x1b294f297b1ec034 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ec02d expref: 17 pid: 5829 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813041.590176:0:8497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b23100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875706322647808:0@lo:104: 00000100:00100000:3.0:1788813041.590311:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322648192 00000100:00100000:3.0:1788813041.590323:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322648192 00000100:00100000:3.0:1788813041.590397:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788813041.590409:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:8497:x1875706322648192:12345-0@lo:104: 00010000:00010000:3.0:1788813041.590427:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef01516e00/0x1b294f297b1ebfcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ebfd2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813041.590506:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788813041.590510:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:8497:x1875706322648192:12345-0@lo:104: Request processed in 106us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813041.590515:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788813041.590534:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813041.590544:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef01516e00/0x1b294f297b1ebfcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ebfd2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813041.590554:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef01516e00 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:0.0:1788813041.590558:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef01516e00/0x1b294f297b1ebfcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ebfd2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813041.590569:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef01516e00/0x1b294f297b1ebfcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ebfd2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813041.590577:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef01516e00/0x1b294f297b1ebfcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ebfd2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813041.590582:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788813041.590617:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef01516e00/0x1b294f297b1ebfcb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ebfd2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813041.590624:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813041.590644:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef01516e00/0x1b294f297b1ebfcb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ebfd2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813041.590653:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef01516e00/0x1b294f297b1ebfcb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ebfd2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813041.590670:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813041.590672:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813041.590674:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813041.590682:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788813041.590691:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322648320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813041.590737:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813041.590826:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322648320 00000100:00100000:3.0:1788813041.590831:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322648320 00010000:00010000:3.0:1788813041.590864:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef01517200/0x1b294f297b1ebfd2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ebfcb expref: 17 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813041.590888:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788813041.590892:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:3301:x1875706322648320:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813041.591129:0:8497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b23800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875706322648192:0@lo:104: 00010000:00010000:3.0:1788813041.591149:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813041.591158:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef01517200/0x1b294f297b1ebfd2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ebfcb expref: 17 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813041.591170:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef01517200/0x1b294f297b1ebfd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ebfcb expref: 17 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813041.591188:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef01517200/0x1b294f297b1ebfd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ebfcb expref: 17 pid: 5827 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813041.591207:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813041.591252:0:8497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b22300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875706322647552:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788813041.591260:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:3301:x1875706322648320:12345-0@lo:103:ldlm_bl.0 Request processed in 364us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813041.591268:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788813041.591299:0:8497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ec25d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813041.591322:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322648320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813041.594598:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813041.594694:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307941888 00000100:00100000:3.0:1788813041.594707:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307941888 00010000:00010000:3.0:1788813041.594755:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef1164ee00/0x1b294f297b1ec1bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce295e expref: 10 pid: 5827 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813041.594979:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:3.0:1788813041.595170:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2aa2133f-e434-4510-82b0-9799a685adfa+10:2366:x1875706307941888:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813041.595195:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813041.595217:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef1164ee00/0x1b294f297b1ec1bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce295e expref: 10 pid: 5827 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813041.595232:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef1164ee00/0x1b294f297b1ec1bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce295e expref: 10 pid: 5827 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813041.595255:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef1164ee00/0x1b294f297b1ec1bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce295e expref: 10 pid: 5827 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813041.595277:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ec25d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813041.595286:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ec25d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813041.595305:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ec25d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813041.595312:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ec25d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813041.595319:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ec25d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813041.595326:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ec25d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813041.595334:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214ce00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813041.595339:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ec25d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813041.595347:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ec25d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813041.597540:0:8497:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ec25d lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813041.597562:0:8497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ec25d lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813041.599917:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ec25d lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813041.599942:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ec25d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813041.599969:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813041.600179:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2aa2133f-e434-4510-82b0-9799a685adfa+9:2366:x1875706307941888:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 5183us (5587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813041.600191:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00010000:00010000:0.0:1788813041.759404:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813041.773030:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813041.773110:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307942016 00000100:00100000:3.0:1788813041.773122:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307942016 00000100:00100000:3.0:1788813041.773188:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 168 00000100:00100000:3.0:1788813041.773200:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+9:5600:x1875706307942016:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813041.773223:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813041.773249:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef1164ee00/0x1b294f297b1ec264 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x78c59908dfce299d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813041.773284:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef1164ee00/0x1b294f297b1ec264 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce299d expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813041.773296:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef1164ee00/0x1b294f297b1ec264 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce299d expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813041.773306:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164ee00, rc 0) 00000100:00100000:3.0:1788813041.773387:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+10:5600:x1875706307942016:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 189us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813041.773395:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 168 00000100:00100000:0.0:1788813041.785187:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813041.785268:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307942144 00000100:00100000:2.0:1788813041.785281:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307942144 00000100:00100000:2.0:1788813041.785404:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 169 00000100:00100000:2.0:1788813041.785418:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+10:5600:x1875706307942144:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813041.785823:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+10:5600:x1875706307942144:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 407us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813041.785833:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 169 00000100:00100000:3.0:1788813041.790820:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813041.790939:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307942272 00000100:00100000:0.0:1788813041.790952:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307942272 00000100:00100000:0.0:1788813041.791060:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 170 00000100:00100000:0.0:1788813041.791072:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+10:5600:x1875706307942272:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813041.791378:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+10:5600:x1875706307942272:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 308us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813041.791388:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 170 00000100:00100000:0.0:1788813041.795231:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813041.795443:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307942400 00000100:00100000:2.0:1788813041.795458:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307942400 00000100:00100000:2.0:1788813041.795522:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 171 00000100:00100000:2.0:1788813041.795533:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21325850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+10:6120:x1875706307942400:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788813041.795891:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21325850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+10:6120:x1875706307942400:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 358us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813041.795901:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 171 00000100:00100000:1.0:1788813041.804506:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813041.807549:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307942528 00000100:00100000:0.0:1788813041.807571:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307942528 00000100:00100000:0.0:1788813041.807671:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 172 00000100:00100000:0.0:1788813041.807682:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21327850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+10:6120:x1875706307942528:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788813041.808071:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21327850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+10:6120:x1875706307942528:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 388us (3573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813041.808080:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 172 00010000:00010000:0.0:1788813042.782980:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813042.845671:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1875706322648832:0@lo:400:kworker.0 00000100:00100000:1.0:1788813042.845769:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813042.845893:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788813042.845900:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875706322648704:0@lo:400:kworker.0 00000100:00100000:1.0:1788813042.845927:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813042.845956:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322649216:0@lo:400:kworker.0 00000100:00100000:1.0:1788813042.845994:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813042.846043:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322649216 00000100:00100000:1.0:1788813042.846052:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322649216 00000100:00100000:1.0:1788813042.846124:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788813042.846134:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322649216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813042.846195:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322649216:12345-0@lo:400:kworker.0 Request processed in 62us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813042.846204:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788813042.846215:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322648576:0@lo:400:kworker.0 00000100:00100000:0.0:1788813042.846310:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322648448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813042.846453:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322648832 00000100:00100000:3.0:1788813042.846458:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322648832 00000100:00100000:3.0:1788813042.846492:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322648704 00000100:00100000:3.0:1788813042.846495:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322648704 00000100:00100000:3.0:1788813042.846517:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788813042.846524:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875706322648832:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788813042.846570:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef36b22680 x1875706322649216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813042.846587:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322649216:0@lo:400:kworker.0 00000100:00080000:1.0:1788813042.846649:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788813042.846655:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813042.846668:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788813042.846675:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875706322648704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813042.847338:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813042.847402:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1875706322649088:0@lo:400:kworker.0 00000100:00100000:2.0:1788813042.847443:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813042.847472:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813042.847483:0:5836:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788813042.847496:0:5836:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1788813042.847501:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322648960:0@lo:400:kworker.0 00000100:00100000:2.0:1788813042.847519:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322648576 00000100:00100000:2.0:1788813042.847526:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322648576 00000100:00100000:0.0:1788813042.847530:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813042.847570:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322648448 00000100:00100000:2.0:1788813042.847576:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788813042.847583:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322648448 00000100:00100000:2.0:1788813042.847589:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21326050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:3300:x1875706322648576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813042.847641:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21326050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:3300:x1875706322648576:12345-0@lo:400:kworker.0 Request processed in 54us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813042.847645:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788813042.847655:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788813042.847659:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322648448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813042.847696:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813042.847741:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322648448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813042.847748:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788813042.847771:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322648960 00000100:00100000:0.0:1788813042.847776:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322648960 00000100:00100000:2.0:1788813042.847827:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322648576:0@lo:400:kworker.0 00000100:00100000:0.0:1788813042.847837:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788813042.847847:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322648960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813042.847873:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322649088 00000100:00100000:2.0:1788813042.847877:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322649088 00000100:00100000:0.0:1788813042.847885:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322648960:12345-0@lo:400:kworker.0 Request processed in 41us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813042.847893:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788813042.847907:0:5836:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788813042.847918:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788813042.847925:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875706322649088:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788813042.847927:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788813042.847934:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788813042.847972:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef354c6680 x1875706322648448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813058 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813042.847975:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875706322649088:12345-0@lo:400:kworker.0 Request processed in 49us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813042.847984:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788813042.848014:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1875706322649088:0@lo:400:kworker.0 00000100:00100000:0.0:1788813042.848212:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322648448:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788813042.848232:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef36b21c00 x1875706322648960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813042.848246:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322648960:0@lo:400:kworker.0 00000100:00100000:3.0:1788813042.849588:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875706322648832:12345-0@lo:400:kworker.0 Request processed in 3055us (3810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813042.849603:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788813042.849680:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875706322648704:12345-0@lo:400:kworker.0 Request processed in 3003us (3750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813042.849688:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788813042.849739:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875706322648704:0@lo:400:kworker.0 00000100:00100000:0.0:1788813042.849775:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1875706322648832:0@lo:400:kworker.0 00000100:00100000:1.0:1788813043.361586:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813043.361608:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322649344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813043.361672:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813043.362013:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322649344 00000100:00100000:0.0:1788813043.362022:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322649344 00000100:00100000:0.0:1788813043.362069:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788813043.362077:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322649344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788813043.362111:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813043.362161:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322649344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813043.362167:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788813043.362179:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef36b22680 x1875706322649344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813043.362198:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322649344:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1788813043.422400:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788813043.422407:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ee0532b000 from 4 10000000:01000000:0.0:1788813043.422411:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788813043.422456:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef00031000/0x1b294f297b1ec26b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813043.422467:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef00031000/0x1b294f297b1ec26b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813043.422488:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef00031000/0x1b294f297b1ec26b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813043.422512:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ef7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322649472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788813043.422573:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813043.422700:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef078b0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788813043.422761:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322649472 00000100:00100000:2.0:1788813043.422768:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322649472 00000100:00100000:2.0:1788813043.422836:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788813043.422844:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:5831:x1875706322649472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813043.422856:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813043.422878:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef21618400/0x1b294f297b1ec272 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec26b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813043.422900:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef21618400/0x1b294f297b1ec272 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec26b expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813043.422911:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef21618400/0x1b294f297b1ec272 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec26b expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813043.422919:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21618400, rc 0) 00000100:00100000:2.0:1788813043.422951:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322649472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813043.422958:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788813043.423259:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ef7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322649472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813043.423272:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef00031000/0x1b294f297b1ec26b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec272 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813043.423291:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef00031000/0x1b294f297b1ec26b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec272 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813043.423348:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ef7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322649600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813043.423373:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813043.423427:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322649600 00000100:00100000:2.0:1788813043.423431:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322649600 00000100:00100000:2.0:1788813043.423457:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788813043.423463:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322649600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813043.423662:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322649600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 199us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813043.423668:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788813043.425894:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef078b0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788813043.425934:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ef7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322649600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813043.425990:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322649728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813043.426060:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813043.426144:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2235a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813043.426191:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322649728 00000100:00100000:2.0:1788813043.426197:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322649728 00000100:00100000:2.0:1788813043.426277:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788813043.426286:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21326c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322649728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813043.427138:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21326c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322649728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813043.427149:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788813043.427271:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322649728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813043.427698:0:8607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ef6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8607:1875706322649856:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813043.427755:0:8607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813043.427808:0:8607:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef078b0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788813043.427861:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322649856 00000100:00100000:3.0:1788813043.427867:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322649856 00000100:00100000:3.0:1788813043.427903:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788813043.427912:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:8607:x1875706322649856:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813043.428187:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:8607:x1875706322649856:12345-0@lo:502:llog_process_th.0 Request processed in 276us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813043.428195:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788813043.428262:0:8607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ef6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8607:1875706322649856:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788813043.428286:0:8607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813043.428294:0:8607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813043.428296:0:8607:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788813043.428303:0:8607:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93ee0532b000 00000020:00000080:1.0:1788813043.428305:0:8607:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788813043.428421:0:8607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b22680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8607:1875706322649984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813043.428456:0:8607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813043.428492:0:8607:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef078a7780 going to sleep for 11 seconds 00000100:00100000:2.0:1788813043.428602:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322649984 00000100:00100000:2.0:1788813043.428615:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322649984 00000100:00100000:2.0:1788813043.428652:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788813043.428659:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21326850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:8607:x1875706322649984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813043.428833:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21326850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:8607:x1875706322649984:12345-0@lo:502:llog_process_th.0 Request processed in 174us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813043.428842:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788813043.428858:0:8607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b22680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8607:1875706322649984:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788813043.428883:0:8607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813043.428889:0:8607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813043.428891:0:8607:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788813043.428894:0:8607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788813043.429047:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788813043.429062:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788813043.429070:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef00031000/0x1b294f297b1ec26b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec272 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813043.429082:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef00031000/0x1b294f297b1ec26b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec272 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813043.429091:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788813043.429094:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ef197e7800 from 4 10000000:01000000:3.0:1788813043.429097:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788813043.429119:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164e000/0x1b294f297b1ec279 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813043.429132:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef1164e000/0x1b294f297b1ec279 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813043.429142:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef1164e000/0x1b294f297b1ec279 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813043.429156:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322650112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788813043.429184:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813043.429211:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef21238000 going to sleep for 11 seconds 00000100:00100000:1.0:1788813043.429515:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322650112 00000100:00100000:1.0:1788813043.429521:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322650112 00000100:00100000:1.0:1788813043.429556:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788813043.429563:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21325450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322650112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813043.429573:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813043.429584:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef4214d000/0x1b294f297b1ec280 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec279 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813043.429606:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef4214d000/0x1b294f297b1ec280 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec279 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813043.429616:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef4214d000/0x1b294f297b1ec280 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec279 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813043.429624:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef4214d000, rc 0) 00000100:00100000:1.0:1788813043.429671:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21325450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322650112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813043.429677:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788813043.429863:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322650112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813043.429876:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef1164e000/0x1b294f297b1ec279 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec280 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813043.429886:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef1164e000/0x1b294f297b1ec279 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec280 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813043.429936:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322650240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813043.429964:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813043.429994:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e11c240 going to sleep for 11 seconds 00000100:00100000:3.0:1788813043.430041:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322650240 00000100:00100000:3.0:1788813043.430046:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322650240 00000100:00100000:3.0:1788813043.430070:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788813043.430076:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322650240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813043.430291:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322650240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 214us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813043.430298:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788813043.430448:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322650240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813043.430476:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322650368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813043.430512:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813043.430556:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e11c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788813043.432562:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322650368 00000100:00100000:1.0:1788813043.432575:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322650368 00000100:00100000:1.0:1788813043.432622:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788813043.432631:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21325c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322650368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813043.433321:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21325c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322650368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 689us (2806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813043.433379:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788813043.436140:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322650368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813043.436663:0:8610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b22680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8610:1875706322650496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813043.436725:0:8610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813043.436768:0:8610:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef113a9780 going to sleep for 11 seconds 00000100:00100000:3.0:1788813043.436874:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322650496 00000100:00100000:3.0:1788813043.436880:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322650496 00000100:00100000:3.0:1788813043.436924:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788813043.436934:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21327050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:8610:x1875706322650496:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813043.437128:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21327050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:8610:x1875706322650496:12345-0@lo:502:llog_process_th.0 Request processed in 195us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813043.437136:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788813043.437265:0:8610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b22680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8610:1875706322650496:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788813043.437287:0:8610:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813043.437296:0:8610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813043.437299:0:8610:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788813043.437305:0:8610:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93ef197e7800 00000020:00000080:1.0:1788813043.437308:0:8610:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788813043.437393:0:8610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b22680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8610:1875706322650624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813043.437429:0:8610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813043.437458:0:8610:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef113a9780 going to sleep for 11 seconds 00000100:00100000:2.0:1788813043.437506:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322650624 00000100:00100000:2.0:1788813043.437510:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322650624 00000100:00100000:2.0:1788813043.437543:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788813043.437550:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:8610:x1875706322650624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813043.437676:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:8610:x1875706322650624:12345-0@lo:502:llog_process_th.0 Request processed in 126us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813043.437683:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788813043.438195:0:8610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b22680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8610:1875706322650624:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788813043.438218:0:8610:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813043.438223:0:8610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813043.438224:0:8610:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788813043.438228:0:8610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788813043.438387:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788813043.438404:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788813043.438414:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164e000/0x1b294f297b1ec279 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec280 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813043.438425:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef1164e000/0x1b294f297b1ec279 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec280 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813043.438436:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788813043.438438:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ef2171d800 from 4 10000000:01000000:2.0:1788813043.438441:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788813043.438464:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef21619c00/0x1b294f297b1ec287 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813043.438473:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef21619c00/0x1b294f297b1ec287 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813043.438482:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef21619c00/0x1b294f297b1ec287 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813043.438496:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322650752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788813043.438531:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813043.438566:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e11c180 going to sleep for 11 seconds 00000100:00100000:3.0:1788813043.438642:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322650752 00000100:00100000:3.0:1788813043.438647:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322650752 00000100:00100000:3.0:1788813043.438682:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788813043.438696:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21326450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322650752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813043.438707:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813043.438719:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef1164e600/0x1b294f297b1ec28e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec287 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813043.438740:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef1164e600/0x1b294f297b1ec28e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec287 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813043.438750:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef1164e600/0x1b294f297b1ec28e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec287 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813043.438759:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164e600, rc 0) 00000100:00100000:3.0:1788813043.438824:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21326450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:5831:x1875706322650752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813043.438831:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788813043.438948:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322650752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813043.438961:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef21619c00/0x1b294f297b1ec287 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec28e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813043.438971:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef21619c00/0x1b294f297b1ec287 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec28e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813043.439014:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322650880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813043.439048:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813043.439077:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef113a9780 going to sleep for 11 seconds 00000100:00100000:3.0:1788813043.439143:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322650880 00000100:00100000:3.0:1788813043.439148:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322650880 00000100:00100000:3.0:1788813043.439178:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788813043.439184:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07822850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:5831:x1875706322650880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813043.439454:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07822850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:5831:x1875706322650880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 270us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813043.439462:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788813043.446512:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322650880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813043.446577:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322651008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813043.446659:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813043.446706:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e11c900 going to sleep for 11 seconds 00000100:00100000:1.0:1788813043.446819:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322651008 00000100:00100000:1.0:1788813043.446827:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322651008 00000100:00100000:1.0:1788813043.446875:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788813043.446883:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:5831:x1875706322651008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813043.447062:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:5831:x1875706322651008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813043.447070:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788813043.447162:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322651008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813043.447484:0:8611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8611:1875706322651136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813043.447522:0:8611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813043.447551:0:8611:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e11c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788813043.447600:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322651136 00000100:00100000:1.0:1788813043.447605:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322651136 00000100:00100000:1.0:1788813043.447634:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788813043.447641:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:8611:x1875706322651136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813043.447768:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:8611:x1875706322651136:12345-0@lo:502:llog_process_th.0 Request processed in 126us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813043.447774:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788813043.447836:0:8611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8611:1875706322651136:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788813043.447857:0:8611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813043.447865:0:8611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813043.447868:0:8611:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788813043.447874:0:8611:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93ef2171d800 00000020:00000080:1.0:1788813043.447877:0:8611:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788813043.447941:0:8611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b21180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8611:1875706322651264:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813043.447976:0:8611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813043.447995:0:8611:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef113a9840 going to sleep for 11 seconds 00000100:00100000:2.0:1788813043.448045:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322651264 00000100:00100000:2.0:1788813043.448049:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322651264 00000100:00100000:2.0:1788813043.448081:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788813043.448088:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:8611:x1875706322651264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813043.448199:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:8611:x1875706322651264:12345-0@lo:502:llog_process_th.0 Request processed in 111us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813043.448206:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788813043.448284:0:8611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b21180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:8611:1875706322651264:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788813043.448311:0:8611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813043.448316:0:8611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813043.448317:0:8611:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788813043.448320:0:8611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788813043.449929:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788813043.449954:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788813043.449965:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef21619c00/0x1b294f297b1ec287 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec28e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813043.449977:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef21619c00/0x1b294f297b1ec287 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec28e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813043.805049:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813044.832166:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813045.706760:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813045.707091:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813045.707118:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813045.707153:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813045.707182:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307942784 00000100:00100000:3.0:1788813045.707191:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307942784 00000100:00100000:3.0:1788813045.707258:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:3.0:1788813045.707268:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2363:x1875706307942784:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813045.707357:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2363:x1875706307942784:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 90us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813045.707365:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:3.0:1788813045.707387:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307942912 00000100:00100000:3.0:1788813045.707391:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307942912 00000100:00100000:3.0:1788813045.707417:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307943040 00000100:00100000:3.0:1788813045.707419:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307943040 00000100:00100000:3.0:1788813045.707437:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:3.0:1788813045.707443:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+5:2363:x1875706307942912:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813045.707467:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+5:2363:x1875706307942912:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813045.707473:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:3.0:1788813045.707483:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:3.0:1788813045.707488:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+5:2363:x1875706307943040:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813045.707507:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+5:2363:x1875706307943040:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 19us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813045.707512:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00080000:3.0:1788813045.707524:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813045.707528:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788813045.707530:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813045.707735:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307942656 00000100:00100000:2.0:1788813045.707740:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307942656 00000100:00100000:2.0:1788813045.707777:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 189 00000100:00100000:2.0:1788813045.707804:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+10:2363:x1875706307942656:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813045.707839:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+10:2363:x1875706307942656:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 37us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813045.707854:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 189 00010000:00010000:2.0:1788813045.858192:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788813046.043980:0:8796:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1788813046.878079:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813047.903711:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813047.966681:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322651392:0@lo:400:kworker.0 00000100:00100000:3.0:1788813047.966749:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813047.966810:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1875706322651904:0@lo:400:kworker.0 00000100:00100000:3.0:1788813047.966932:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813047.966958:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788813047.966964:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322651520:0@lo:400:kworker.0 00000100:00100000:3.0:1788813047.967104:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813047.967123:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322652032:0@lo:400:kworker.0 00000100:00100000:3.0:1788813047.967144:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813047.967183:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322651776:0@lo:400:kworker.0 00000100:00100000:3.0:1788813047.967203:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813047.967219:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788813047.967263:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1875706322651648:0@lo:400:kworker.0 00000100:00100000:3.0:1788813047.967285:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813047.967360:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322651904 00000100:00100000:3.0:1788813047.967368:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322651904 00000100:00100000:3.0:1788813047.967411:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322651520 00000100:00100000:3.0:1788813047.967414:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322651520 00000100:00100000:3.0:1788813047.967433:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322651648 00000100:00100000:3.0:1788813047.967436:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322651648 00000100:00100000:3.0:1788813047.967456:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788813047.967465:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875706322651904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813047.967516:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875706322651904:12345-0@lo:400:kworker.0 Request processed in 52us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813047.967523:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788813047.967542:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788813047.967550:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322651520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813047.967578:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322651520:12345-0@lo:400:kworker.0 Request processed in 30us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813047.967585:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788813047.967606:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788813047.967613:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875706322651648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813047.967649:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875706322651648:12345-0@lo:400:kworker.0 Request processed in 37us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813047.967655:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788813047.967680:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322652032 00000100:00100000:3.0:1788813047.967684:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322652032 00000100:00100000:3.0:1788813047.967712:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322651776 00000100:00100000:3.0:1788813047.967715:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322651776 00000100:00100000:3.0:1788813047.967740:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788813047.967746:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322652032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813047.967802:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322652032:12345-0@lo:400:kworker.0 Request processed in 35us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813047.967808:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788813047.967820:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788813047.967826:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322651776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813047.967852:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322651776:12345-0@lo:400:kworker.0 Request processed in 26us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813047.967858:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788813047.967876:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788813047.967879:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813047.967882:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813047.967914:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1875706322651648:0@lo:400:kworker.0 00010000:00080000:3.0:1788813047.967926:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef354c4380 x1875706322651776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813047.967935:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322651776:0@lo:400:kworker.0 00000100:00100000:3.0:1788813047.967964:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788813047.967971:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322652160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813047.967995:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813047.968033:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322651520:0@lo:400:kworker.0 00010000:00080000:3.0:1788813047.968044:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef354c7800 x1875706322652032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813047.968053:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322652032:0@lo:400:kworker.0 00000100:00100000:3.0:1788813047.968063:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1875706322651904:0@lo:400:kworker.0 00000100:00100000:1.0:1788813047.973254:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322652160 00000100:00100000:1.0:1788813047.973270:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322652160 00000100:00100000:1.0:1788813047.973347:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788813047.973357:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322652160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788813047.973395:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813047.973474:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322652160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (5476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813047.973481:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788813047.973508:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322651392 00000100:00100000:1.0:1788813047.973511:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322651392 00000100:00100000:1.0:1788813047.973532:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788813047.973538:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3299:x1875706322651392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813047.973574:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3299:x1875706322651392:12345-0@lo:400:kworker.0 Request processed in 36us (6824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813047.973580:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00010000:00080000:1.0:1788813047.973650:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef3ae7a300 x1875706322652160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813047.973670:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322652160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813047.973701:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322651392:0@lo:400:kworker.0 00000100:00100000:0.0:1788813048.477197:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788813048.477220:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322652288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813048.477290:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813048.477849:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322652288 00000100:00100000:1.0:1788813048.477858:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322652288 00000100:00100000:1.0:1788813048.477901:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788813048.477917:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322652288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788813048.477948:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813048.478006:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322652288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813048.478012:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788813048.478090:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef36b21180 x1875706322652288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813048.478109:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322652288:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788813048.924962:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813049.952598:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788813050.639404:0:9041:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing yml_node 00000100:00100000:2.0:1788813050.832420:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813050.832463:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813050.832473:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307943168 00000100:00100000:3.0:1788813050.832482:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307943168 00000100:00100000:2.0:1788813050.832498:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813050.832522:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813050.832527:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 191 00000100:00100000:3.0:1788813050.832536:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+10:2363:x1875706307943168:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813050.832570:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307943424 00000100:00100000:0.0:1788813050.832574:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307943424 00000100:00100000:3.0:1788813050.832606:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+10:2363:x1875706307943168:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 70us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813050.832614:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 191 00000100:00100000:3.0:1788813050.832646:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307943296 00000100:00100000:3.0:1788813050.832650:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307943296 00000100:00100000:0.0:1788813050.832677:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307943552 00000100:00100000:0.0:1788813050.832680:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307943552 00000100:00100000:3.0:1788813050.832681:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:3.0:1788813050.832688:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+6:2363:x1875706307943296:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813050.832707:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:0.0:1788813050.832715:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+5:2363:x1875706307943424:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813050.832720:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+6:2363:x1875706307943296:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 33us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813050.832861:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:0.0:1788813050.832876:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+5:2363:x1875706307943424:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 27us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813050.832883:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:3.0:1788813050.832887:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:3.0:1788813050.832894:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+5:2363:x1875706307943552:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813050.833023:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+5:2363:x1875706307943552:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 129us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813050.833030:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00080000:3.0:1788813050.833047:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813050.833052:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788813050.833054:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788813050.974429:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813051.998308:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813053.021009:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813053.087599:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322652416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813053.087664:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813053.087803:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322652416 00000100:00100000:0.0:1788813053.087811:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322652416 00000100:00100000:0.0:1788813053.087866:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788813053.087874:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322652416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813053.087904:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813053.087947:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322652416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813053.087954:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788813053.087986:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef3ae79880 x1875706322652416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813053.088014:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322652416:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788813053.092521:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813053.092876:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322652672:0@lo:400:kworker.0 00000100:00100000:3.0:1788813053.092954:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322652544:0@lo:400:kworker.0 00000100:00100000:2.0:1788813053.092996:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813053.093006:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813053.093153:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322652544 00000100:00100000:3.0:1788813053.093160:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322652544 00000100:00100000:3.0:1788813053.093196:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788813053.093204:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21385050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3300:x1875706322652544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813053.093245:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21385050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3300:x1875706322652544:12345-0@lo:400:kworker.0 Request processed in 42us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813053.093252:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788813053.093293:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1875706322652800:0@lo:400:kworker.0 00000100:00100000:3.0:1788813053.093316:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813053.093343:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322652672 00000100:00100000:3.0:1788813053.093346:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322652672 00000100:00100000:3.0:1788813053.093365:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322652800 00000100:00100000:3.0:1788813053.093367:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322652800 00000100:00100000:3.0:1788813053.093386:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788813053.093392:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322652672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813053.095188:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788813053.095206:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875706322652800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813053.095284:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875706322652800:12345-0@lo:400:kworker.0 Request processed in 76us (1956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813053.095291:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788813053.095339:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1875706322652800:0@lo:400:kworker.0 00000100:00100000:0.0:1788813053.095383:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322652544:0@lo:400:kworker.0 00000100:00080000:0.0:1788813053.095399:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813053.102772:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322653056:0@lo:400:kworker.0 00000100:00100000:1.0:1788813053.102839:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1875706322652928:0@lo:400:kworker.0 00000100:00100000:1.0:1788813053.102898:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813053.102949:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322652928 00000100:00100000:1.0:1788813053.102955:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322652928 00000100:00100000:1.0:1788813053.103012:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788813053.103019:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875706322652928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813053.103059:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875706322652928:12345-0@lo:400:kworker.0 Request processed in 40us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813053.103064:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788813053.103094:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1875706322652928:0@lo:400:kworker.0 00000100:00080000:1.0:1788813053.103113:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813053.103326:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813053.104155:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322653056 00000100:00100000:1.0:1788813053.104161:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322653056 00000100:00100000:1.0:1788813053.104202:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788813053.104207:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322653056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813053.104246:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322653056:12345-0@lo:400:kworker.0 Request processed in 39us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813053.104251:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788813053.104391:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788813053.104413:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef36b21c00 x1875706322653056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813053.104433:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322653056:0@lo:400:kworker.0 00000100:00100000:3.0:1788813053.104819:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322652672:12345-0@lo:400:kworker.0 Request processed in 11425us (11824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813053.104827:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788813053.107232:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322652672:0@lo:400:kworker.0 00000100:00100000:2.0:1788813053.597126:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322653184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813053.597208:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813053.597441:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322653184 00000100:00100000:1.0:1788813053.597449:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322653184 00000100:00100000:1.0:1788813053.597504:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788813053.597513:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322653184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788813053.597545:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813053.597601:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322653184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813053.597609:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788813053.597699:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef36b23800 x1875706322653184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813053.597717:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322653184:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788813054.045502:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813055.069431:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788813055.445156:0:9233:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.41 00000100:00100000:2.0:1788813055.963298:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813055.963335:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813055.963366:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813055.963405:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813055.963436:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307943936 00000100:00100000:2.0:1788813055.963445:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307943936 00000100:00100000:2.0:1788813055.963514:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307944064 00000100:00100000:2.0:1788813055.963518:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307944064 00000100:00100000:2.0:1788813055.963543:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:2.0:1788813055.963553:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+5:2362:x1875706307943936:12345-192.168.203.13@tcp:9:kworker.0 00000100:00100000:1.0:1788813055.963556:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307943680 00000100:00100000:1.0:1788813055.963560:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307943680 00000020:00000080:2.0:1788813055.963588:0:6677:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ec1ca 00000100:00100000:1.0:1788813055.963590:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 193 00000100:00100000:1.0:1788813055.963597:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+10:2365:x1875706307943680:12345-192.168.203.13@tcp:400:kworker.0 00000100:00080000:2.0:1788813055.963605:0:6677:0:(import.c:65:import_set_state_nolock()) ffff93ef212e2000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788813055.963643:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788813055.963655:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+10:2365:x1875706307943680:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 59us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813055.963662:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 193 00000100:00100000:2.0:1788813055.963964:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+2:2362:x1875706307943936:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 412us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813055.963971:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:2.0:1788813055.963985:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:2.0:1788813055.963991:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+5:2362:x1875706307944064:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:2.0:1788813055.964004:0:6677:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ec1d1 00000100:00080000:2.0:1788813055.964011:0:6677:0:(import.c:65:import_set_state_nolock()) ffff93ef212e6800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788813055.964032:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1788813055.964047:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813055.964230:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+2:2362:x1875706307944064:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 238us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813055.964237:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00080000:2.0:1788813055.964270:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813055.964274:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788813055.964333:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813055.964505:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307943808 00000100:00100000:0.0:1788813055.964511:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307943808 00000100:00100000:0.0:1788813055.964563:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:0.0:1788813055.964571:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+6:2365:x1875706307943808:12345-192.168.203.13@tcp:400:kworker.0 00000100:00080000:1.0:1788813055.964587:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813055.964617:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+6:2365:x1875706307943808:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 46us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813055.964623:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00010000:00010000:1.0:1788813056.092917:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788813056.285727:0:6700:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9c560788-da9a-41fd-952d-091d96dace11 00000020:00000080:3.0:1788813056.285736:0:6700:0:(genops.c:885:class_export_put()) final put ffff93ef212e2800/9c560788-da9a-41fd-952d-091d96dace11 00000020:00000080:3.0:1788813056.285761:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef212e2800/9c560788-da9a-41fd-952d-091d96dace11 for lustre-OST0000 00000020:00000080:3.0:1788813056.285817:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93ef212e2000 for lustre-OST0000 00010000:00010000:2.0:1788813057.121233:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813058.140978:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813058.205168:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813058.205191:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322653312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813058.205266:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813058.205454:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322653312 00000100:00100000:1.0:1788813058.205463:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322653312 00000100:00100000:1.0:1788813058.205520:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788813058.205537:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322653312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788813058.205570:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813058.205618:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322653312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813058.205637:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788813058.205706:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef3ae7b480 x1875706322653312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813058.205725:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322653312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813058.206198:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875706322653568:0@lo:400:kworker.0 00000100:00100000:0.0:1788813058.206264:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813058.206295:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788813058.206301:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322653440:0@lo:400:kworker.0 00000100:00100000:0.0:1788813058.206328:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813058.206348:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322653952:0@lo:400:kworker.0 00000100:00100000:0.0:1788813058.206369:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813058.206396:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322653952 00000100:00100000:0.0:1788813058.206400:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322653952 00000100:00100000:0.0:1788813058.206432:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788813058.206439:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322653952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813058.206475:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322653952:12345-0@lo:400:kworker.0 Request processed in 37us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813058.206482:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788813058.206512:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1875706322653824:0@lo:400:kworker.0 00000100:00100000:0.0:1788813058.206536:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813058.206552:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788813058.206557:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1875706322653696:0@lo:400:kworker.0 00000100:00100000:0.0:1788813058.206575:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813058.206598:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322653568 00000100:00100000:0.0:1788813058.206601:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322653568 00000100:00100000:0.0:1788813058.206622:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322653824 00000100:00100000:0.0:1788813058.206638:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322653824 00000100:00100000:0.0:1788813058.206667:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322653696 00000100:00100000:0.0:1788813058.206670:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322653696 00000100:00100000:0.0:1788813058.206696:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788813058.206702:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875706322653568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813058.206732:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875706322653568:12345-0@lo:400:kworker.0 Request processed in 30us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813058.206738:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788813058.206749:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788813058.206755:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875706322653824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813058.206804:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875706322653824:12345-0@lo:400:kworker.0 Request processed in 49us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813058.206811:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788813058.206822:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788813058.206828:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875706322653696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813058.206853:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875706322653696:12345-0@lo:400:kworker.0 Request processed in 26us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813058.206859:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788813058.206890:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1875706322653696:0@lo:400:kworker.0 00000100:00100000:0.0:1788813058.206908:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1875706322653824:0@lo:400:kworker.0 00010000:00080000:0.0:1788813058.206938:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ee06d53800 x1875706322653952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813058.206947:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322653952:0@lo:400:kworker.0 00000100:00100000:0.0:1788813058.206956:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875706322653568:0@lo:400:kworker.0 00000100:00080000:2.0:1788813058.207188:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788813058.207193:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813058.207196:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813058.207865:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322653440 00000100:00100000:3.0:1788813058.207874:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322653440 00000100:00100000:3.0:1788813058.207927:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788813058.207936:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21387050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3300:x1875706322653440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813058.208000:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21387050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3300:x1875706322653440:12345-0@lo:400:kworker.0 Request processed in 65us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813058.208007:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788813058.210878:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322653440:0@lo:400:kworker.0 00000100:00100000:2.0:1788813058.717004:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322654080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813058.717090:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813058.717247:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322654080 00000100:00100000:1.0:1788813058.717257:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322654080 00000100:00100000:1.0:1788813058.717303:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788813058.717324:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322654080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788813058.717362:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813058.717408:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322654080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813058.717415:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788813058.717713:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef36b22300 x1875706322654080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813058.717730:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322654080:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788813059.167354:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788813060.110164:0:9331:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.41 00010000:00010000:1.0:1788813060.189095:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788813060.473283:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9c560788-da9a-41fd-952d-091d96dace11 00000020:00000080:0.0:1788813060.473296:0:7632:0:(genops.c:885:class_export_put()) final put ffff93ef212e6000/9c560788-da9a-41fd-952d-091d96dace11 00000020:00000080:0.0:1788813060.473356:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef212e6000/9c560788-da9a-41fd-952d-091d96dace11 for lustre-OST0001 00000020:00000080:0.0:1788813060.473426:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93ef212e6800 for lustre-OST0001 00000100:00100000:3.0:1788813061.068382:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813061.068444:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813061.069009:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307944192 00000100:00100000:1.0:1788813061.069022:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307944192 00000100:00100000:1.0:1788813061.069081:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 195 00000100:00100000:1.0:1788813061.069091:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21387450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+10:2366:x1875706307944192:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813061.069342:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21387450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+10:2366:x1875706307944192:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 251us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813061.069351:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 195 00000100:00100000:0.0:1788813061.069985:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307944320 00000100:00100000:0.0:1788813061.069994:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307944320 00000100:00100000:0.0:1788813061.070053:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:0.0:1788813061.070062:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2366:x1875706307944320:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813061.070109:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2366:x1875706307944320:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 48us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813061.070116:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00080000:3.0:1788813061.071455:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788813061.214949:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813062.765574:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813063.861439:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322654208:0@lo:400:kworker.0 00000100:00100000:2.0:1788813063.861537:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813063.861594:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322654720:0@lo:400:kworker.0 00000100:00100000:2.0:1788813063.861623:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813063.861651:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788813063.861657:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322654336:0@lo:400:kworker.0 00000100:00100000:2.0:1788813063.861679:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813063.861697:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322654848:0@lo:400:kworker.0 00000100:00100000:2.0:1788813063.861720:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813063.861751:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322654464:0@lo:400:kworker.0 00000100:00100000:2.0:1788813063.861775:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813063.861816:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322654976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813063.861840:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813063.861860:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813063.861866:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322654592:0@lo:400:kworker.0 00000100:00100000:2.0:1788813063.861914:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813063.861951:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322654208 00000100:00100000:2.0:1788813063.861961:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322654208 00000100:00100000:2.0:1788813063.862135:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788813063.862146:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3301:x1875706322654208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813063.862275:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3301:x1875706322654208:12345-0@lo:400:kworker.0 Request processed in 131us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813063.862283:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788813063.862324:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322654720 00000100:00100000:2.0:1788813063.862328:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322654720 00000100:00100000:2.0:1788813063.862375:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322654336 00000100:00100000:2.0:1788813063.862379:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322654336 00000100:00100000:2.0:1788813063.862397:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322654464 00000100:00100000:2.0:1788813063.862400:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322654464 00000100:00100000:2.0:1788813063.862415:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788813063.862420:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875706322654720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813063.862451:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875706322654720:12345-0@lo:400:kworker.0 Request processed in 30us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813063.862457:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788813063.862467:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788813063.862472:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322654336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813063.862492:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322654336:12345-0@lo:400:kworker.0 Request processed in 20us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813063.862497:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788813063.862506:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788813063.862510:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322654464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813063.862533:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322654464:12345-0@lo:400:kworker.0 Request processed in 23us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813063.862538:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788813063.862558:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322654848 00000100:00100000:2.0:1788813063.862561:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322654848 00000100:00100000:2.0:1788813063.862583:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322654592 00000100:00100000:2.0:1788813063.862585:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322654592 00000100:00100000:2.0:1788813063.862603:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788813063.862609:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322654848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813063.862633:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322654848:12345-0@lo:400:kworker.0 Request processed in 25us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813063.862647:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788813063.862657:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788813063.862661:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3e33aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322654592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813063.862684:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3e33aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322654592:12345-0@lo:400:kworker.0 Request processed in 23us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813063.862688:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788813063.862707:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322654976 00000100:00100000:2.0:1788813063.862710:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322654976 00000100:00100000:2.0:1788813063.862729:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788813063.862735:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322654976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813063.862764:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813063.862822:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322654976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813063.862828:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788813063.862851:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788813063.862856:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813063.862859:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788813063.862902:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef35f2df80 x1875706322654592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813063.862916:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322654592:0@lo:400:kworker.0 00000100:00100000:2.0:1788813063.862925:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322654464:0@lo:400:kworker.0 00010000:00080000:2.0:1788813063.862933:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef35f2dc00 x1875706322654976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813063.862944:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322654976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813063.863074:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322654336:0@lo:400:kworker.0 00010000:00080000:2.0:1788813063.863083:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef35f2f800 x1875706322654848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813063.863091:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322654848:0@lo:400:kworker.0 00000100:00100000:2.0:1788813063.863097:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322654208:0@lo:400:kworker.0 00000100:00100000:2.0:1788813063.863105:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322654720:0@lo:400:kworker.0 00000100:00100000:2.0:1788813063.946706:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3e339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322655104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813063.946823:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813063.946901:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322655104 00000100:00100000:2.0:1788813063.946912:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322655104 00000100:00100000:2.0:1788813063.946966:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788813063.946976:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3e339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322655104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813063.947019:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813063.947564:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3e339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322655104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 588us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813063.947575:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788813063.947642:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef3e339880 x1875706322655104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813063.947665:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3e339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322655104:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788813063.960885:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813064.989371:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788813065.403705:0:9431:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.41 00010000:00010000:3.0:1788813066.023754:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813066.192064:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813066.192108:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813066.192230:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307944448 00000100:00100000:1.0:1788813066.192239:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307944448 00000100:00100000:1.0:1788813066.192283:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 197 00000100:00100000:1.0:1788813066.192292:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+10:2363:x1875706307944448:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813066.192359:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+10:2363:x1875706307944448:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 67us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813066.192379:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 197 00000100:00100000:0.0:1788813066.221394:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307944576 00000100:00100000:0.0:1788813066.221410:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307944576 00000100:00100000:2.0:1788813066.226225:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:2.0:1788813066.226239:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+6:2363:x1875706307944576:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813066.226319:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+6:2363:x1875706307944576:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 82us (34208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813066.226343:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00080000:3.0:1788813066.226402:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788813067.038453:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788813067.785932:0:9479:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Sep 7 16:31:05 EDT 2026 00010000:00010000:3.0:1788813068.061361:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813068.957795:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3e339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322655232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813068.957873:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813068.957919:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322655488:0@lo:400:kworker.0 00000100:00100000:2.0:1788813068.957933:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef21246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322655744:0@lo:400:kworker.0 00000100:00100000:2.0:1788813068.957966:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813068.957987:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788813068.957991:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813068.957994:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322655360:0@lo:400:kworker.0 00000100:00100000:2.0:1788813068.958027:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813068.958030:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef21246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322656000:0@lo:400:kworker.0 00000100:00100000:3.0:1788813068.958069:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813068.958069:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef21244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322655872:0@lo:400:kworker.0 00000100:00100000:3.0:1788813068.958102:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813068.958103:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813068.958112:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322655616:0@lo:400:kworker.0 00000100:00100000:2.0:1788813068.958143:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322655232 00000100:00100000:3.0:1788813068.958148:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813068.958151:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322655232 00000100:00100000:2.0:1788813068.958224:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788813068.958232:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3e338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322655232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813068.958263:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813068.958304:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3e338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322655232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813068.958311:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788813068.958331:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322655744 00000100:00100000:2.0:1788813068.958335:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322655744 00000100:00100000:3.0:1788813068.958360:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322655488 00000100:00100000:2.0:1788813068.958361:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322656000 00000100:00100000:2.0:1788813068.958366:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322656000 00000100:00100000:3.0:1788813068.958367:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322655488 00000100:00100000:2.0:1788813068.958389:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788813068.958398:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3e33a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322655744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813068.958410:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322655872 00000100:00100000:3.0:1788813068.958415:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322655872 00000100:00100000:2.0:1788813068.958434:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3e33a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322655744:12345-0@lo:400:kworker.0 Request processed in 37us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813068.958441:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322655616 00000100:00100000:3.0:1788813068.958445:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322655616 00000100:00100000:2.0:1788813068.958451:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788813068.958468:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788813068.958478:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322656000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813068.958483:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788813068.958494:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322655488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813068.958522:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322656000:12345-0@lo:400:kworker.0 Request processed in 46us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813068.958539:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322655488:12345-0@lo:400:kworker.0 Request processed in 47us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813068.958542:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788813068.958549:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788813068.958569:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788813068.958574:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3e339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875706322655872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813068.958579:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322655360 00000100:00100000:2.0:1788813068.958584:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322655360 00000100:00100000:2.0:1788813068.958615:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788813068.958620:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3e339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875706322655872:12345-0@lo:400:kworker.0 Request processed in 33us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813068.958623:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3301:x1875706322655360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813068.958633:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788813068.958657:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788813068.958663:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3301:x1875706322655360:12345-0@lo:400:kworker.0 Request processed in 41us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813068.958668:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322655616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813068.958676:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788813068.958709:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322655616:12345-0@lo:400:kworker.0 Request processed in 45us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813068.958716:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788813068.958731:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322655360:0@lo:400:kworker.0 00000100:00080000:3.0:1788813068.958748:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813068.958750:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef21244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322655872:0@lo:400:kworker.0 00000100:00080000:3.0:1788813068.958754:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813068.958758:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788813068.958765:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef21246d80 x1875706322655744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813068.958775:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef21246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322655744:0@lo:400:kworker.0 00000100:00100000:3.0:1788813068.958809:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322655616:0@lo:400:kworker.0 00010000:00080000:2.0:1788813068.958817:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef3e339880 x1875706322655232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813068.958826:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322655488:0@lo:400:kworker.0 00000100:00100000:2.0:1788813068.958833:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3e339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322655232:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788813068.958841:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef21246680 x1875706322656000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813068.958853:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef21246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322656000:0@lo:400:kworker.0 00000100:00100000:3.0:1788813068.962270:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322656128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813068.962333:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813068.967295:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322656128 00000100:00100000:2.0:1788813068.967309:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322656128 00000100:00100000:2.0:1788813068.967493:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788813068.967504:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322656128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813068.967551:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813068.971430:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322656128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3920us (9088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813068.971444:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788813068.973860:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef36b22300 x1875706322656128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813068.973885:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322656128:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788813069.085228:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813070.292202:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813071.314605:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813071.314649:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813071.314769:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307944704 00000100:00100000:0.0:1788813071.314769:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307944832 00000100:00100000:3.0:1788813071.314778:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307944704 00000100:00100000:0.0:1788813071.314778:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307944832 00000100:00100000:3.0:1788813071.314846:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 199 00000100:00100000:0.0:1788813071.314846:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:3.0:1788813071.314855:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+10:2365:x1875706307944704:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813071.314867:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2365:x1875706307944832:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813071.314918:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2365:x1875706307944832:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 52us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813071.314926:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00080000:0.0:1788813071.314957:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813071.315142:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+10:2365:x1875706307944704:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 287us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813071.315162:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 199 00010000:00010000:2.0:1788813071.326549:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813072.349567:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813073.379492:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813074.077096:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3e339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322656256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813074.077191:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813074.077434:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322656256 00000100:00100000:2.0:1788813074.077444:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322656256 00000100:00100000:2.0:1788813074.077507:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788813074.077516:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322656256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813074.077546:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813074.077857:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322656256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 342us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813074.077865:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788813074.078093:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788813074.078125:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef3e339880 x1875706322656256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813074.078236:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3e339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322656256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813074.078920:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3e33b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322656512:0@lo:400:kworker.0 00000100:00100000:2.0:1788813074.078959:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813074.079367:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3e338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322656384:0@lo:400:kworker.0 00000100:00100000:3.0:1788813074.079412:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813074.079484:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3e339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1875706322656640:0@lo:400:kworker.0 00000100:00100000:1.0:1788813074.079514:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813074.079540:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813074.079545:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322657024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813074.079563:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813074.080140:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3e338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322656896:0@lo:400:kworker.0 00000100:00100000:3.0:1788813074.080174:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813074.080190:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788813074.080195:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3e338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1875706322656768:0@lo:400:kworker.0 00000100:00100000:3.0:1788813074.080212:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813074.080238:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322656512 00000100:00100000:3.0:1788813074.080244:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322656512 00000100:00100000:3.0:1788813074.080280:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322656640 00000100:00100000:3.0:1788813074.080293:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322656640 00000100:00100000:3.0:1788813074.080314:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322656768 00000100:00100000:3.0:1788813074.080316:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322656768 00000100:00100000:3.0:1788813074.080329:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788813074.080335:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3e33b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322656512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813074.080378:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3e33b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322656512:12345-0@lo:400:kworker.0 Request processed in 43us (1418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813074.080384:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788813074.080398:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788813074.080403:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875706322656640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813074.080423:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875706322656640:12345-0@lo:400:kworker.0 Request processed in 20us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813074.080428:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788813074.080436:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788813074.080440:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875706322656768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813074.080467:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875706322656768:12345-0@lo:400:kworker.0 Request processed in 27us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813074.080486:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788813074.080526:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3e33b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322656512:0@lo:400:kworker.0 00000100:00100000:3.0:1788813074.080547:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3e338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1875706322656768:0@lo:400:kworker.0 00000100:00100000:1.0:1788813074.081197:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3e339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1875706322656640:0@lo:400:kworker.0 00000100:00100000:1.0:1788813074.081230:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322657024 00000100:00100000:1.0:1788813074.081236:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322657024 00000100:00100000:1.0:1788813074.081268:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788813074.081275:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322657024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788813074.081302:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813074.081348:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322657024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (1783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813074.081353:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788813074.081380:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef354c6680 x1875706322657024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813074.081410:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322657024:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788813074.081454:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788813074.081458:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813074.083732:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322656896 00000100:00100000:2.0:1788813074.083746:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322656896 00000100:00100000:2.0:1788813074.083846:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788813074.083857:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21245880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322656896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813074.083943:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21245880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322656896:12345-0@lo:400:kworker.0 Request processed in 89us (3768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813074.083950:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788813074.085506:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef3e338a80 x1875706322656896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813074.085522:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3e338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322656896:0@lo:400:kworker.0 00000100:00100000:0.0:1788813074.088320:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322656384 00000100:00100000:0.0:1788813074.088338:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322656384 00000100:00100000:1.0:1788813074.088568:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788813074.088589:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3302:x1875706322656384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813074.088901:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3302:x1875706322656384:12345-0@lo:400:kworker.0 Request processed in 314us (9486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813074.088909:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788813074.089020:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3e338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322656384:0@lo:400:kworker.0 00010000:00010000:3.0:1788813074.397957:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813075.420919:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813076.435971:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813076.436020:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813076.436260:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307944960 00000100:00100000:3.0:1788813076.436270:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307944960 00000100:00100000:3.0:1788813076.436327:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 201 00000100:00100000:3.0:1788813076.436337:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+10:2365:x1875706307944960:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813076.436408:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+10:2365:x1875706307944960:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 72us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813076.436415:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 201 00000100:00100000:1.0:1788813076.437903:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307945088 00000100:00100000:1.0:1788813076.437914:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307945088 00000100:00100000:1.0:1788813076.438021:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:1.0:1788813076.438032:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+6:2365:x1875706307945088:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813076.438209:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+6:2365:x1875706307945088:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 179us (2187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813076.438219:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00080000:0.0:1788813076.439759:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788813076.448422:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813077.471807:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813078.494646:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813079.197036:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813079.197058:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3e33b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322657152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813079.197136:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813079.197236:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322657152 00000100:00100000:2.0:1788813079.197245:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322657152 00000100:00100000:2.0:1788813079.197303:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788813079.197311:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322657152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813079.197345:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813079.197390:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322657152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813079.197397:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788813079.197444:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788813079.197474:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef3e33b800 x1875706322657152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813079.197493:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3e33b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322657152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813079.197905:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322657280:0@lo:400:kworker.0 00000100:00100000:2.0:1788813079.197940:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813079.197972:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322657792:0@lo:400:kworker.0 00000100:00100000:2.0:1788813079.197994:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813079.198014:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813079.198020:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322657408:0@lo:400:kworker.0 00000100:00100000:2.0:1788813079.198042:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813079.198065:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322657792 00000100:00100000:2.0:1788813079.198070:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322657792 00000100:00100000:2.0:1788813079.198114:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788813079.198122:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3e33ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322657792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813079.198158:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3e33ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322657792:12345-0@lo:400:kworker.0 Request processed in 37us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813079.198164:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788813079.198192:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef35733800 x1875706322657792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813079.198203:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322657792:0@lo:400:kworker.0 00000100:00080000:0.0:1788813079.198291:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788813079.198300:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322657536:0@lo:400:kworker.0 00000100:00100000:0.0:1788813079.198337:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813079.198357:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813079.198362:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1875706322657664:0@lo:400:kworker.0 00000100:00100000:0.0:1788813079.198391:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813079.198419:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322657408 00000100:00100000:0.0:1788813079.198423:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322657408 00000100:00100000:0.0:1788813079.198450:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322657536 00000100:00100000:0.0:1788813079.198453:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322657536 00000100:00100000:0.0:1788813079.198473:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322657664 00000100:00100000:0.0:1788813079.198476:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322657664 00000100:00100000:0.0:1788813079.198490:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788813079.198495:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3e338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322657408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813079.198525:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3e338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322657408:12345-0@lo:400:kworker.0 Request processed in 30us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813079.198531:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788813079.198559:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788813079.198565:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322657536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813079.198597:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322657536:12345-0@lo:400:kworker.0 Request processed in 32us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813079.198602:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788813079.198613:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788813079.198620:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875706322657664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813079.198644:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875706322657664:12345-0@lo:400:kworker.0 Request processed in 26us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813079.198650:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788813079.198673:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813079.198690:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1875706322657664:0@lo:400:kworker.0 00000100:00100000:0.0:1788813079.198709:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322657536:0@lo:400:kworker.0 00000100:00100000:2.0:1788813079.198965:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322657408:0@lo:400:kworker.0 00000100:00100000:2.0:1788813079.198982:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813079.198989:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322657920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813079.199014:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813079.199037:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322657920 00000100:00100000:2.0:1788813079.199041:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322657920 00000100:00100000:2.0:1788813079.199060:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788813079.199066:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3e33a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322657920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813079.199086:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813079.199132:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3e33a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322657920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813079.199138:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788813079.199159:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef354c5180 x1875706322657920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813079.199173:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322657920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813079.199307:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322657280 00000100:00100000:1.0:1788813079.199311:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322657280 00000100:00100000:1.0:1788813079.199345:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788813079.199351:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3301:x1875706322657280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813079.199394:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3301:x1875706322657280:12345-0@lo:400:kworker.0 Request processed in 44us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813079.199409:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788813079.199674:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322657280:0@lo:400:kworker.0 00010000:00010000:3.0:1788813079.526467:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813080.548255:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813081.550722:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813081.550767:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813081.550822:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307945344 00000100:00100000:0.0:1788813081.550831:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307945344 00000100:00100000:0.0:1788813081.550964:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:0.0:1788813081.550979:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2363:x1875706307945344:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813081.551052:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2363:x1875706307945344:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 77us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813081.551060:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00080000:0.0:1788813081.551090:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813081.552852:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307945216 00000100:00100000:2.0:1788813081.552865:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307945216 00000100:00100000:2.0:1788813081.552928:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 203 00000100:00100000:2.0:1788813081.552937:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+10:2363:x1875706307945216:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813081.553000:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+10:2363:x1875706307945216:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 64us (2289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813081.553007:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 203 00010000:00010000:3.0:1788813081.566401:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813082.589605:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813083.613113:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813084.317337:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ecb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322658304:0@lo:400:kworker.0 00000100:00100000:0.0:1788813084.317404:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813084.317461:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322658816:0@lo:400:kworker.0 00000100:00100000:0.0:1788813084.317487:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813084.317594:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788813084.317602:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322658432:0@lo:400:kworker.0 00000100:00100000:0.0:1788813084.317627:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813084.317658:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322658304 00000100:00100000:0.0:1788813084.317664:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322658304 00000100:00100000:0.0:1788813084.317708:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322658432 00000100:00100000:0.0:1788813084.317711:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322658432 00000100:00100000:0.0:1788813084.317738:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788813084.317747:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322658304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813084.317825:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322658304:12345-0@lo:400:kworker.0 Request processed in 79us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813084.317849:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788813084.317867:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788813084.317873:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322658432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813084.318000:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322658176:0@lo:400:kworker.0 00000100:00100000:3.0:1788813084.318038:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813084.318146:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1875706322658688:0@lo:400:kworker.0 00000100:00100000:3.0:1788813084.318172:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813084.318194:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788813084.318200:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3e339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322658048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813084.318224:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813084.318252:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322658560:0@lo:400:kworker.0 00000100:00100000:3.0:1788813084.318275:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813084.318307:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322658176 00000100:00100000:3.0:1788813084.318311:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322658176 00000100:00100000:3.0:1788813084.318339:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788813084.318345:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3300:x1875706322658176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813084.318377:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3300:x1875706322658176:12345-0@lo:400:kworker.0 Request processed in 33us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813084.318383:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788813084.318408:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322658688 00000100:00100000:3.0:1788813084.318411:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322658688 00000100:00100000:3.0:1788813084.318429:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788813084.318434:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875706322658688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813084.318483:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322658432:12345-0@lo:400:kworker.0 Request processed in 610us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813084.318489:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788813084.319008:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322658816 00000100:00100000:0.0:1788813084.319014:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322658816 00000100:00100000:0.0:1788813084.319046:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322658560 00000100:00100000:0.0:1788813084.319049:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322658560 00000100:00100000:0.0:1788813084.319163:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788813084.319171:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322658816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813084.319214:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322658816:12345-0@lo:400:kworker.0 Request processed in 44us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813084.319220:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788813084.319232:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788813084.319238:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322658560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813084.319265:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322658560:12345-0@lo:400:kworker.0 Request processed in 28us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813084.319270:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788813084.319295:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788813084.319299:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788813084.319301:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813084.319342:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322658432:0@lo:400:kworker.0 00000100:00100000:0.0:1788813084.319354:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ecb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322658304:0@lo:400:kworker.0 00010000:00080000:0.0:1788813084.319365:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef36ec9f80 x1875706322658816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813084.319385:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322658816:0@lo:400:kworker.0 00000100:00100000:0.0:1788813084.319438:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322658048 00000100:00100000:0.0:1788813084.319442:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322658048 00000100:00100000:0.0:1788813084.319465:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788813084.319470:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322658048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788813084.319496:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:2.0:1788813084.319684:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef36ec8380 x1875706322658560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813084.319706:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322658560:0@lo:400:kworker.0 00000100:00100000:2.0:1788813084.319718:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322658176:0@lo:400:kworker.0 00000100:00100000:2.0:1788813084.319752:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3e33bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322658944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813084.319806:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813084.319838:0:6678:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788813084.319847:0:6678:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1788813084.319959:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322658944 00000100:00100000:2.0:1788813084.319963:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322658944 00000100:00100000:2.0:1788813084.320033:0:10074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788813084.320040:0:10074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3e33b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322658944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813084.320201:0:10074:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813084.320241:0:10074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3e33b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322658944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 201us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813084.320247:0:10074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788813084.320274:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef3e33bb80 x1875706322658944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813084.320289:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3e33bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322658944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813084.321037:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322658048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1563us (2808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813084.321045:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788813084.323734:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef3e339f80 x1875706322658048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813084.323759:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3e339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322658048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813084.329472:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875706322658688:12345-0@lo:400:kworker.0 Request processed in 11027us (11289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813084.329486:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788813084.338765:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1875706322658688:0@lo:400:kworker.0 00010000:00010000:2.0:1788813084.637035:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788813085.497341:0:10111:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 16:31:23 (1788813083) === 00010000:00010000:3.0:1788813085.668917:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813086.409541:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813086.409694:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307945472 00000100:00100000:1.0:1788813086.409703:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307945472 00000100:00100000:1.0:1788813086.409758:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 205 00000100:00100000:1.0:1788813086.409768:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+10:8137:x1875706307945472:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788813086.409810:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813086.409830:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ec295 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x78c59908dfce29a4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813086.409859:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ec295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce29a4 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813086.409870:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ec295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce29a4 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813086.409879:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef4214ce00, rc 0) 00000100:00100000:1.0:1788813086.409937:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+11:8137:x1875706307945472:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 171us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813086.409944:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 205 00000100:00100000:3.0:1788813086.431912:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813086.432119:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307945600 00000100:00100000:2.0:1788813086.432129:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307945600 00000100:00100000:2.0:1788813086.432186:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 206 00000100:00100000:2.0:1788813086.432196:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+11:8137:x1875706307945600:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788813086.432481:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+11:8137:x1875706307945600:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 285us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813086.432489:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 206 00000100:00100000:0.0:1788813086.438321:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813086.438403:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307945728 00000100:00100000:3.0:1788813086.438414:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307945728 00000100:00100000:3.0:1788813086.438472:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 207 00000100:00100000:3.0:1788813086.438482:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+11:8137:x1875706307945728:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788813086.438719:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+11:8137:x1875706307945728:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 238us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813086.438728:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 207 00000100:00100000:0.0:1788813086.458776:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813086.458908:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307945856 00000100:00100000:2.0:1788813086.458918:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307945856 00000100:00100000:2.0:1788813086.458978:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 208 00000100:00100000:2.0:1788813086.458988:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+11:8141:x1875706307945856:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788813086.459275:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+11:8141:x1875706307945856:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 288us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813086.459284:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 208 00000100:00100000:2.0:1788813086.502878:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813086.503159:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307945984 00000100:00100000:1.0:1788813086.503174:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307945984 00000100:00100000:1.0:1788813086.503305:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 209 00000100:00100000:1.0:1788813086.503328:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+11:8141:x1875706307945984:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788813086.503621:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+11:8141:x1875706307945984:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 305us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813086.503640:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 209 00000100:00100000:0.0:1788813086.520858:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813086.524630:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307946112 00000100:00100000:3.0:1788813086.524644:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307946112 00000100:00100000:3.0:1788813086.524731:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 210 00000100:00100000:3.0:1788813086.524742:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+11:8137:x1875706307946112:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788813086.524760:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813086.524794:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef1164f200/0x1b294f297b1ec29c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x78c59908dfce29ce expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813086.524826:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef1164f200/0x1b294f297b1ec29c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce29ce expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813086.524838:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef1164f200/0x1b294f297b1ec29c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce29ce expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813086.524848:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164f200, rc 0) 00000100:00100000:3.0:1788813086.524915:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+12:8137:x1875706307946112:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 174us (4066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813086.524923:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 210 00000100:00100000:0.0:1788813086.528411:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813086.528599:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307946240 00000100:00100000:1.0:1788813086.528610:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307946240 00000100:00100000:1.0:1788813086.528666:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 211 00000100:00100000:1.0:1788813086.528676:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+12:8137:x1875706307946240:12345-192.168.203.13@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788813086.528701:0:5827:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788813086.528723:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788813086.528727:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788813086.528731:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788813086.528733:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788813086.539694:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+12:8137:x1875706307946240:12345-192.168.203.13@tcp:256:mount.lustre.0 Request processed in 11009us (11279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813086.539708:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 211 00000100:00100000:0.0:1788813086.543948:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813086.544092:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307946368 00000100:00100000:3.0:1788813086.544101:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307946368 00000100:00100000:3.0:1788813086.544152:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 212 00000100:00100000:3.0:1788813086.544161:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+12:8137:x1875706307946368:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788813086.544176:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813086.544191:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef1164f000/0x1b294f297b1ec2a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x78c59908dfce29d5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813086.544220:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef1164f000/0x1b294f297b1ec2a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce29d5 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813086.544232:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef1164f000/0x1b294f297b1ec2a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce29d5 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813086.544254:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164f000, rc 0) 00000100:00100000:3.0:1788813086.544329:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+13:8137:x1875706307946368:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 167us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813086.544336:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 212 00000100:00100000:2.0:1788813086.550870:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813086.550980:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307946496 00000100:00100000:1.0:1788813086.551563:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307946496 00000100:00100000:1.0:1788813086.551625:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 213 00000100:00100000:1.0:1788813086.551636:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+13:8137:x1875706307946496:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788813086.552083:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+13:8137:x1875706307946496:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 448us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813086.552092:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 213 00000100:00100000:1.0:1788813086.569177:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813086.569310:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307946624 00000100:00100000:2.0:1788813086.569322:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307946624 00000100:00100000:2.0:1788813086.569376:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 214 00000100:00100000:2.0:1788813086.569386:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+13:8137:x1875706307946624:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788813086.569618:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+13:8137:x1875706307946624:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 233us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813086.569626:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 214 00000100:00100000:0.0:1788813086.595121:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813086.595254:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307946752 00000100:00100000:3.0:1788813086.595265:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307946752 00000100:00100000:3.0:1788813086.595321:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 215 00000100:00100000:3.0:1788813086.595331:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+13:8144:x1875706307946752:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788813086.595598:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+13:8144:x1875706307946752:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 266us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813086.595606:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 215 00000100:00100000:0.0:1788813086.614418:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813086.614569:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307946880 00000100:00100000:1.0:1788813086.614578:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307946880 00000100:00100000:1.0:1788813086.615095:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 216 00000100:00100000:1.0:1788813086.615107:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+13:8144:x1875706307946880:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788813086.615366:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+13:8144:x1875706307946880:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 261us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813086.615376:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 216 00000100:00100000:1.0:1788813086.619291:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813086.620979:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307947136 00000100:00100000:0.0:1788813086.620992:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307947136 00000100:00100000:2.0:1788813086.621138:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813086.621285:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307947008 00000100:00100000:0.0:1788813086.621290:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307947008 00000100:00100000:2.0:1788813086.623609:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:2.0:1788813086.623634:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+6:2363:x1875706307947136:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813086.623743:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+6:2363:x1875706307947136:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 122us (4461us total) trans 0 rc 0/0 00000100:00080000:3.0:1788813086.624348:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813086.629437:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:1.0:1788813086.629453:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3e339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2362:x1875706307947008:12345-192.168.203.13@tcp:38:mount.lustre.0 00000100:00100000:2.0:1788813086.629473:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00010000:00080000:1.0:1788813086.629499:0:5834:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64@192.168.203.13@tcp t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:1.0:1788813086.629538:0:5834:0:(genops.c:1384:class_connect()) connect: client d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64, cookie 0x1b294f297b1ec2aa 00000004:00100000:1.0:1788813086.629568:0:5834:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788813086.629866:0:5834:0:(import.c:65:import_set_state_nolock()) ffff93ef217b5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813086.629949:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3e339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+6:2362:x1875706307947008:12345-192.168.203.13@tcp:38:mount.lustre.0 Request processed in 497us (8813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813086.629957:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:2.0:1788813086.651405:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813086.651440:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813086.651526:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307947264 00000100:00100000:0.0:1788813086.651536:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307947264 00000100:00100000:0.0:1788813086.651616:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307947392 00000100:00100000:0.0:1788813086.651619:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307947392 00000100:00100000:0.0:1788813086.651641:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:0.0:1788813086.651650:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3e33bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+7:0:x1875706307947264:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788813086.651701:0:5835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788813086.651808:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3e33bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+7:0:x1875706307947264:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 131us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813086.651816:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:0.0:1788813086.651842:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:0.0:1788813086.651849:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3e338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+6:8137:x1875706307947392:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788813086.651860:0:5835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788813086.651881:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3e338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+6:8137:x1875706307947392:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 33us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813086.651887:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00080000:1.0:1788813086.656511:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813086.665389:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813086.665512:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307947520 00000100:00100000:1.0:1788813086.665521:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307947520 00000100:00100000:1.0:1788813086.665580:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:1.0:1788813086.665590:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3e338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+6:8137:x1875706307947520:12345-192.168.203.13@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788813086.665671:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3e338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+6:8137:x1875706307947520:12345-192.168.203.13@tcp:40:mount.lustre.0 Request processed in 83us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813086.665679:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:3.0:1788813086.671241:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813086.671289:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813086.671349:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813086.671386:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307947904 00000100:00100000:2.0:1788813086.671401:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307947904 00000100:00100000:1.0:1788813086.671555:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307947648 00000100:00100000:1.0:1788813086.671560:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307947648 00000100:00100000:1.0:1788813086.671584:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307947776 00000100:00100000:1.0:1788813086.671587:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307947776 00000100:00100000:1.0:1788813086.671634:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:1.0:1788813086.671641:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1875706307947648:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788813086.671671:0:6677:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64@192.168.203.13@tcp t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:1.0:1788813086.671699:0:6677:0:(genops.c:1384:class_connect()) connect: client d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64, cookie 0x1b294f297b1ec2b1 00002000:00100000:1.0:1788813086.671709:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64/ffff93ef217b1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788813086.671731:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788813086.672004:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788813086.672056:0:6677:0:(import.c:65:import_set_state_nolock()) ffff93ef217b1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788813086.672304:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:0.0:1788813086.672311:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21245180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2362:x1875706307947776:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788813086.672329:0:6676:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64@192.168.203.13@tcp t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:0.0:1788813086.672345:0:6676:0:(genops.c:1384:class_connect()) connect: client d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64, cookie 0x1b294f297b1ec2b8 00002000:00100000:0.0:1788813086.672350:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64/ffff93ef21252000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788813086.672364:0:6676:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788813086.672497:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788813086.672514:0:6676:0:(import.c:65:import_set_state_nolock()) ffff93ef21256000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813086.672566:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+6:2362:x1875706307947648:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 923us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813086.672574:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:2.0:1788813086.672690:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:2.0:1788813086.672701:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+6:8137:x1875706307947904:12345-192.168.203.13@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788813086.672760:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788813086.682270:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21245180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+6:2362:x1875706307947776:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 9945us (10908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813086.682284:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:2.0:1788813086.683333:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+6:8137:x1875706307947904:12345-192.168.203.13@tcp:33:mount.lustre.0 Request processed in 10626us (12110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813086.683345:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00010000:00010000:2.0:1788813086.686997:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788813086.973480:0:6700:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64 00010000:00010000:3.0:1788813087.709420:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813088.741651:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813089.438423:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3e33b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322659328:0@lo:400:kworker.0 00000100:00100000:2.0:1788813089.438488:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813089.438551:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813089.438557:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3e339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322659456:0@lo:400:kworker.0 00000100:00100000:2.0:1788813089.438594:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813089.438632:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322659456 00000100:00100000:2.0:1788813089.438639:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322659456 00000100:00100000:2.0:1788813089.438691:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788813089.438699:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322659456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813089.438884:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3e339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322659072:0@lo:400:kworker.0 00000100:00100000:3.0:1788813089.439912:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3e338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875706322659200:0@lo:400:kworker.0 00000100:00100000:2.0:1788813089.441084:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322659456:12345-0@lo:400:kworker.0 Request processed in 2379us (2494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813089.441106:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788813089.441142:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813089.441213:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322659968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813089.444305:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813089.444388:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1875706322659584:0@lo:400:kworker.0 00000100:00100000:0.0:1788813089.444427:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813089.444479:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322659328 00000100:00100000:0.0:1788813089.444488:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322659328 00000100:00100000:0.0:1788813089.444541:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322659584 00000100:00100000:0.0:1788813089.444545:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322659584 00000100:00100000:0.0:1788813089.444569:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788813089.444577:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322659328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813089.449850:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322659328:12345-0@lo:400:kworker.0 Request processed in 5269us (11357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813089.449863:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788813089.449896:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788813089.449909:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875706322659584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813089.449957:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875706322659584:12345-0@lo:400:kworker.0 Request processed in 53us (5530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813089.449964:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788813089.449993:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322659072 00000100:00100000:0.0:1788813089.450000:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322659072 00000100:00100000:0.0:1788813089.450051:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788813089.450059:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3299:x1875706322659072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813089.450090:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3299:x1875706322659072:12345-0@lo:400:kworker.0 Request processed in 32us (5793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813089.450096:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:0.0:1788813089.450138:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813089.450172:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3e339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322659072:0@lo:400:kworker.0 00000100:00100000:0.0:1788813089.450186:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1875706322659584:0@lo:400:kworker.0 00000100:00100000:0.0:1788813089.452102:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322659840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813089.452176:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788813089.452228:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef3e339880 x1875706322659456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813089.452241:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3e339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322659456:0@lo:400:kworker.0 00000100:00100000:0.0:1788813089.452254:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3e33b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322659328:0@lo:400:kworker.0 00000100:00100000:0.0:1788813089.452289:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322659840 00000100:00100000:0.0:1788813089.452295:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322659840 00000100:00100000:0.0:1788813089.452348:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788813089.452356:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322659840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788813089.452401:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813089.452435:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813089.452441:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322659840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813089.452448:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788813089.452455:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322659712:0@lo:400:kworker.0 00000100:00080000:0.0:1788813089.452468:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813089.452477:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788813089.452485:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef3ae7b480 x1875706322659840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813089.452499:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322659840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813089.452509:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322659200 00000100:00100000:3.0:1788813089.452512:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322659200 00000100:00100000:3.0:1788813089.452550:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788813089.452564:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875706322659200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813089.452601:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875706322659200:12345-0@lo:400:kworker.0 Request processed in 39us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813089.452607:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788813089.452626:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322659712 00000100:00100000:3.0:1788813089.452629:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322659712 00000100:00100000:3.0:1788813089.452652:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788813089.452658:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322659712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813089.452687:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322659712:12345-0@lo:400:kworker.0 Request processed in 30us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813089.452693:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788813089.452719:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3e338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875706322659200:0@lo:400:kworker.0 00010000:00080000:3.0:1788813089.452729:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ee06d51c00 x1875706322659712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813089.452737:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322659712:0@lo:400:kworker.0 00000100:00100000:2.0:1788813089.456670:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813089.456848:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322659968 00000100:00100000:1.0:1788813089.456858:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322659968 00000100:00100000:1.0:1788813089.456902:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788813089.456911:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322659968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788813089.456948:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813089.457001:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322659968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813089.457008:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788813089.457757:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef35f2d880 x1875706322659968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813089.457797:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322659968:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788813089.758107:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813090.782924:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788813091.068048:0:5856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64 00000001:00100000:1.0:1788813091.071146:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64 00000100:00100000:3.0:1788813091.789140:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813091.789260:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813091.789293:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813091.789395:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307948288 00000100:00100000:0.0:1788813091.789405:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307948288 00000100:00100000:0.0:1788813091.789480:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:0.0:1788813091.789490:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2363:x1875706307948288:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813091.789554:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2363:x1875706307948288:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 66us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813091.789574:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00080000:0.0:1788813091.789593:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813091.793209:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813091.793258:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813091.793335:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307948160 00000100:00100000:0.0:1788813091.793345:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307948160 00000100:00100000:0.0:1788813091.793409:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:0.0:1788813091.793420:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+6:2363:x1875706307948160:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813091.793490:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+6:2363:x1875706307948160:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 72us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813091.793498:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00080000:0.0:1788813091.793554:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813091.797626:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307948032 00000100:00100000:1.0:1788813091.797640:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307948032 00000100:00100000:1.0:1788813091.797699:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 218 00000100:00100000:1.0:1788813091.797709:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+13:2363:x1875706307948032:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813091.797834:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+13:2363:x1875706307948032:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 125us (8702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813091.797841:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 218 00000100:00100000:2.0:1788813091.803940:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307948544 00000100:00100000:2.0:1788813091.803955:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307948544 00000100:00100000:0.0:1788813091.810170:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307948416 00000100:00100000:0.0:1788813091.810181:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307948416 00000100:00100000:3.0:1788813091.810257:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:3.0:1788813091.810270:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2363:x1875706307948544:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813091.810356:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2363:x1875706307948544:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 89us (21060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813091.810391:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 32 00010000:00010000:1.0:1788813091.810803:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788813091.813729:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788813091.813740:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788813091.813971:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:0.0:1788813091.813996:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2363:x1875706307948416:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813091.814080:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2363:x1875706307948416:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 99us (20820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813091.814088:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00010000:00010000:1.0:1788813092.833606:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813093.852901:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788813093.922536:0:10307:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1788813094.557118:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813094.557139:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322660096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813094.557208:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813094.557278:0:10074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322660096 00000100:00100000:2.0:1788813094.557285:0:10074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322660096 00000100:00100000:2.0:1788813094.557344:0:10074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788813094.557354:0:10074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322660096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813094.557389:0:10074:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788813094.557658:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813094.557676:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322660224:0@lo:400:kworker.0 00000100:00100000:0.0:1788813094.557773:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322660352:0@lo:400:kworker.0 00000100:00100000:1.0:1788813094.557877:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322660608:0@lo:400:kworker.0 00000100:00100000:2.0:1788813094.557935:0:10074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322660096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 582us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813094.557943:0:10074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788813094.557967:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1875706322660480:0@lo:400:kworker.0 00000100:00100000:3.0:1788813094.561368:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813094.561448:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1875706322660736:0@lo:400:kworker.0 00000100:00100000:3.0:1788813094.561490:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788813094.561530:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef35f2d880 x1875706322660096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813094.561554:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322660096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813094.561612:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322660736 00000100:00100000:3.0:1788813094.561618:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322660736 00000100:00100000:3.0:1788813094.561669:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788813094.561678:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875706322660736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813094.561725:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875706322660736:12345-0@lo:400:kworker.0 Request processed in 49us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813094.561732:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1788813094.561754:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813094.561958:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1875706322660736:0@lo:400:kworker.0 00000100:00100000:3.0:1788813094.562000:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322660224 00000100:00100000:3.0:1788813094.562004:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322660224 00000100:00100000:3.0:1788813094.562039:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788813094.562046:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3300:x1875706322660224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813094.562084:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3300:x1875706322660224:12345-0@lo:400:kworker.0 Request processed in 38us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813094.562106:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788813094.562141:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322660224:0@lo:400:kworker.0 00000100:00100000:0.0:1788813094.563974:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813094.564045:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322660864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813094.564084:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813094.564121:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322660864 00000100:00100000:0.0:1788813094.564128:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322660864 00000100:00100000:0.0:1788813094.564181:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788813094.564188:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322660864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813094.564234:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813094.564275:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322660864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813094.564283:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788813094.564322:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef36ecad80 x1875706322660864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813094.564341:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322660864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813094.564461:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322660352 00000100:00100000:3.0:1788813094.564466:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322660352 00000100:00100000:3.0:1788813094.564504:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788813094.564511:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322660352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813094.564553:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322660352:12345-0@lo:400:kworker.0 Request processed in 43us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813094.564560:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1788813094.564726:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813094.564921:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813094.565030:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322660352:0@lo:400:kworker.0 00000100:00100000:3.0:1788813094.565090:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322660608 00000100:00100000:3.0:1788813094.565095:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322660608 00000100:00100000:3.0:1788813094.565131:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788813094.565138:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322660608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813094.565183:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322660608:12345-0@lo:400:kworker.0 Request processed in 46us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813094.565190:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1788813094.565292:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef368d3b80 x1875706322660608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813094.565302:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322660608:0@lo:400:kworker.0 00000100:00100000:2.0:1788813094.565486:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813094.565683:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322660480 00000100:00100000:0.0:1788813094.565688:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322660480 00000100:00100000:0.0:1788813094.565737:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788813094.565744:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875706322660480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813094.566085:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875706322660480:12345-0@lo:400:kworker.0 Request processed in 340us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813094.566092:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1788813094.566149:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813094.566340:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1875706322660480:0@lo:400:kworker.0 00010000:00010000:1.0:1788813094.877878:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813095.924692:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813096.910297:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813096.910336:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813096.910368:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813096.910390:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813096.910411:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813096.910436:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307949184 00000100:00100000:3.0:1788813096.910445:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307949184 00000100:00100000:3.0:1788813096.910492:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307949056 00000100:00100000:3.0:1788813096.910495:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307949056 00000100:00100000:3.0:1788813096.910533:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:3.0:1788813096.910542:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2364:x1875706307949184:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813096.910605:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2364:x1875706307949184:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 65us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813096.910613:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:3.0:1788813096.910628:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:3.0:1788813096.910634:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2364:x1875706307949056:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813096.910654:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2364:x1875706307949056:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 21us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813096.910660:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:3.0:1788813096.910676:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307948928 00000100:00100000:3.0:1788813096.910680:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307948928 00000100:00100000:3.0:1788813096.910702:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307948800 00000100:00100000:3.0:1788813096.910704:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307948800 00000100:00100000:3.0:1788813096.910721:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:3.0:1788813096.910727:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2364:x1875706307948928:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813096.910770:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2364:x1875706307948928:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 42us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813096.910776:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:3.0:1788813096.910815:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:3.0:1788813096.910821:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+6:2364:x1875706307948800:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813096.910845:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+6:2364:x1875706307948800:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 24us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813096.910851:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00080000:3.0:1788813096.910871:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788813096.910881:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788813096.910883:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813096.911310:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307948672 00000100:00100000:2.0:1788813096.911315:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307948672 00000100:00100000:2.0:1788813096.911356:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 220 00000100:00100000:2.0:1788813096.911365:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+13:2364:x1875706307948672:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813096.911408:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+13:2364:x1875706307948672:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 44us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813096.911414:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 220 00010000:00010000:1.0:1788813096.924901:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813097.951250:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813098.981310:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813099.677160:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322660992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813099.677230:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813099.677633:0:10074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322660992 00000100:00100000:3.0:1788813099.677640:0:10074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322660992 00000100:00100000:3.0:1788813099.677704:0:10074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788813099.677712:0:10074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322660992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813099.677743:0:10074:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813099.677830:0:10074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322660992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813099.677837:0:10074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788813099.677877:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef36ecad80 x1875706322660992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813115 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813099.677894:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322660992:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788813099.678023:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813099.678168:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322661376:0@lo:400:kworker.0 00000100:00100000:1.0:1788813099.678203:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813099.678226:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813099.678231:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322661504:0@lo:400:kworker.0 00000100:00100000:1.0:1788813099.678252:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813099.678276:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322661376 00000100:00100000:1.0:1788813099.678280:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322661376 00000100:00100000:1.0:1788813099.678313:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322661504 00000100:00100000:1.0:1788813099.678316:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322661504 00000100:00100000:1.0:1788813099.678337:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788813099.678344:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322661376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813099.678380:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322661376:12345-0@lo:400:kworker.0 Request processed in 37us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813099.678387:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788813099.678399:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788813099.678431:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875706322661504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813099.678460:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875706322661504:12345-0@lo:400:kworker.0 Request processed in 32us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813099.678467:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1788813099.678487:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813099.678516:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322661504:0@lo:400:kworker.0 00000100:00100000:1.0:1788813099.678525:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322661376:0@lo:400:kworker.0 00000100:00100000:0.0:1788813099.678599:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322661120:0@lo:400:kworker.0 00000100:00100000:0.0:1788813099.678633:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813099.678662:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322661632:0@lo:400:kworker.0 00000100:00100000:0.0:1788813099.678683:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813099.678698:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813099.678710:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322661248:0@lo:400:kworker.0 00000100:00100000:0.0:1788813099.678729:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813099.678994:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322661120 00000100:00100000:1.0:1788813099.678999:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322661120 00000100:00100000:1.0:1788813099.679037:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788813099.679044:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3299:x1875706322661120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813099.679082:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3299:x1875706322661120:12345-0@lo:400:kworker.0 Request processed in 38us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813099.679087:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788813099.679111:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322661248 00000100:00100000:1.0:1788813099.679115:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322661248 00000100:00100000:1.0:1788813099.679136:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788813099.679142:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322661248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813099.679171:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322661248:12345-0@lo:400:kworker.0 Request processed in 29us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813099.679177:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788813099.679203:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322661248:0@lo:400:kworker.0 00000100:00100000:1.0:1788813099.679212:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322661120:0@lo:400:kworker.0 00000100:00100000:3.0:1788813099.681599:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322661760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813099.681666:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813099.681741:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322661632 00000100:00100000:3.0:1788813099.681748:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322661632 00000100:00100000:3.0:1788813099.681840:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788813099.681849:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36eca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322661632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813099.681895:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36eca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322661632:12345-0@lo:400:kworker.0 Request processed in 48us (3210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813099.681902:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788813099.682212:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322661760 00000100:00100000:0.0:1788813099.682218:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322661760 00000100:00100000:0.0:1788813099.682253:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788813099.682261:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322661760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788813099.682289:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813099.682331:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322661760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813099.682337:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788813099.682386:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef35f2df80 x1875706322661760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813115 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813099.682412:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322661760:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788813099.682638:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788813099.682733:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef35731880 x1875706322661632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813099.682761:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322661632:0@lo:400:kworker.0 00010000:00010000:2.0:1788813100.004177:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813101.021164:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813102.029157:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813102.029197:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813102.029227:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813102.029261:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813102.029289:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813102.029348:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307949568 00000100:00100000:3.0:1788813102.029358:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307949568 00000100:00100000:3.0:1788813102.029422:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307949440 00000100:00100000:3.0:1788813102.029426:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307949440 00000100:00100000:3.0:1788813102.029449:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:3.0:1788813102.029458:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2363:x1875706307949568:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813102.029520:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2363:x1875706307949568:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 63us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813102.029527:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:3.0:1788813102.029541:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:3.0:1788813102.029546:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2364:x1875706307949440:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813102.029564:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2364:x1875706307949440:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 19us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813102.029570:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:3.0:1788813102.029584:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307949824 00000100:00100000:3.0:1788813102.029587:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307949824 00000100:00100000:3.0:1788813102.029863:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307949696 00000100:00100000:3.0:1788813102.029868:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307949696 00000100:00100000:0.0:1788813102.029919:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307949312 00000100:00100000:0.0:1788813102.029923:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307949312 00000100:00100000:0.0:1788813102.029957:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 222 00000100:00100000:0.0:1788813102.029964:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+13:2363:x1875706307949312:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813102.029988:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+13:2363:x1875706307949312:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 26us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813102.029994:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 222 00000100:00080000:0.0:1788813102.030135:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788813102.030139:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788813102.030141:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813102.039804:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:2.0:1788813102.039828:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2363:x1875706307949824:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813102.039903:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2363:x1875706307949824:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 88us (10675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813102.039911:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:2.0:1788813102.039945:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:2.0:1788813102.039953:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2364:x1875706307949696:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813102.039976:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2364:x1875706307949696:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (10687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813102.039982:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00010000:00010000:2.0:1788813102.045044:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813103.068945:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813104.095176:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813104.797963:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875706322662016:0@lo:400:kworker.0 00000100:00100000:2.0:1788813104.797979:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322661888:0@lo:400:kworker.0 00000100:00100000:1.0:1788813104.798030:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813104.798077:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322662528:0@lo:400:kworker.0 00000100:00100000:1.0:1788813104.798101:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813104.798138:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322662144:0@lo:400:kworker.0 00000100:00100000:1.0:1788813104.798160:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813104.798179:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788813104.798185:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322662272:0@lo:400:kworker.0 00000100:00100000:1.0:1788813104.798202:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813104.798232:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322662016 00000100:00100000:1.0:1788813104.798241:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322662016 00000100:00100000:1.0:1788813104.798279:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322662144 00000100:00100000:1.0:1788813104.798282:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322662144 00000100:00100000:1.0:1788813104.798311:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788813104.798318:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875706322662016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813104.798365:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875706322662016:12345-0@lo:400:kworker.0 Request processed in 48us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813104.798373:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788813104.798391:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788813104.798397:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322662144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813104.798427:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322662144:12345-0@lo:400:kworker.0 Request processed in 30us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813104.798448:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788813104.798470:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322662528 00000100:00100000:1.0:1788813104.798473:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322662528 00000100:00100000:1.0:1788813104.798498:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322662272 00000100:00100000:1.0:1788813104.798501:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322662272 00000100:00100000:1.0:1788813104.798520:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788813104.798526:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322662528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813104.798555:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322662528:12345-0@lo:400:kworker.0 Request processed in 30us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813104.798562:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788813104.798572:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788813104.798578:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322662272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813104.798602:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322662272:12345-0@lo:400:kworker.0 Request processed in 25us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813104.798621:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788813104.798653:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef35733b80 x1875706322662272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813104.798667:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322662272:0@lo:400:kworker.0 00000100:00100000:1.0:1788813104.798677:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322662144:0@lo:400:kworker.0 00000100:00100000:1.0:1788813104.798703:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875706322662016:0@lo:400:kworker.0 00000100:00100000:2.0:1788813104.798710:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788813104.798712:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef35732300 x1875706322662528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813104.798720:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322662528:0@lo:400:kworker.0 00000100:00100000:2.0:1788813104.798734:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322662400:0@lo:400:kworker.0 00000100:00100000:2.0:1788813104.798754:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813104.798833:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322661888 00000100:00100000:2.0:1788813104.798837:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322661888 00000100:00100000:1.0:1788813104.798859:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322662400 00000100:00100000:2.0:1788813104.798862:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788813104.798868:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3301:x1875706322661888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813104.798868:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322662400 00000100:00100000:1.0:1788813104.798892:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788813104.798898:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875706322662400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813104.798899:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3301:x1875706322661888:12345-0@lo:400:kworker.0 Request processed in 32us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813104.798905:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788813104.798935:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875706322662400:12345-0@lo:400:kworker.0 Request processed in 38us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813104.798941:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788813104.798947:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322661888:0@lo:400:kworker.0 00000100:00100000:2.0:1788813104.798956:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322662400:0@lo:400:kworker.0 00000100:00080000:1.0:1788813104.800878:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788813104.800885:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788813104.800888:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813104.803549:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322662656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813104.803627:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813104.803770:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322662784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813104.803818:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813104.803945:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322662656 00000100:00100000:0.0:1788813104.803952:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322662656 00000100:00100000:0.0:1788813104.804023:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322662784 00000100:00100000:0.0:1788813104.804026:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322662784 00000100:00100000:3.0:1788813104.809469:0:10074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788813104.809493:0:10074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322662656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813104.809532:0:10074:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813104.809602:0:10074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322662656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (5974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813104.809619:0:10074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788813104.809659:0:10074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788813104.809666:0:10074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322662784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813104.809686:0:10074:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813104.809730:0:10074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322662784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (5911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813104.809736:0:10074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788813104.809802:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef35f2d880 x1875706322662784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813104.809895:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322662784:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788813104.810356:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef36ec8000 x1875706322662656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813104.810380:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322662656:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788813105.116860:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813106.141724:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813107.152678:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813107.152714:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813107.152730:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813107.152753:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813107.153087:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813107.153124:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307950080 00000100:00100000:1.0:1788813107.153133:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307950080 00000100:00100000:1.0:1788813107.153181:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307950208 00000100:00100000:1.0:1788813107.153184:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307950208 00000100:00100000:1.0:1788813107.153204:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:1.0:1788813107.153212:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2363:x1875706307950080:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813107.153281:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2363:x1875706307950080:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 70us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813107.153301:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:1.0:1788813107.153316:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:1.0:1788813107.153322:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2363:x1875706307950208:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813107.154966:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2363:x1875706307950208:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 1635us (2225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813107.154978:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:1.0:1788813107.155010:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307949952 00000100:00100000:1.0:1788813107.155017:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307949952 00000100:00100000:1.0:1788813107.155050:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 224 00000100:00100000:1.0:1788813107.155058:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+13:2363:x1875706307949952:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813107.155099:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+13:2363:x1875706307949952:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 42us (2384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813107.155106:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 224 00000100:00100000:1.0:1788813107.155138:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307950336 00000100:00100000:1.0:1788813107.155142:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307950336 00000100:00100000:1.0:1788813107.155174:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307950464 00000100:00100000:1.0:1788813107.155177:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307950464 00000100:00100000:1.0:1788813107.155199:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:1.0:1788813107.155205:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef369d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2362:x1875706307950336:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:1.0:1788813107.155225:0:8122:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ec2b1 00000100:00080000:1.0:1788813107.155232:0:8122:0:(import.c:65:import_set_state_nolock()) ffff93ef217b1000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788813107.155264:0:8122:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:2.0:1788813107.156049:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813107.156055:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788813107.156058:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813107.156073:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:2.0:1788813107.156084:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2362:x1875706307950464:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:2.0:1788813107.156110:0:6675:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ec2b8 00000100:00080000:2.0:1788813107.156117:0:6675:0:(import.c:65:import_set_state_nolock()) ffff93ef21256000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788813107.156144:0:6675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788813107.156433:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+2:2362:x1875706307950464:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 351us (3345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813107.156440:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00010000:00010000:2.0:1788813107.156464:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813107.157878:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef369d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+2:2362:x1875706307950336:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 2667us (5117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813107.157889:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00010000:00010000:1.0:1788813107.158449:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813107.170796:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788813107.441831:0:6700:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64 00000020:00000080:3.0:1788813107.441840:0:6700:0:(genops.c:885:class_export_put()) final put ffff93ef217b1800/d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64 00000020:00000080:3.0:1788813107.441867:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef217b1800/d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64 for lustre-OST0000 00000020:00000080:3.0:1788813107.441917:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93ef217b1000 for lustre-OST0000 00010000:00010000:1.0:1788813108.189878:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813109.213018:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813109.919927:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322662912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813109.920002:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813109.920136:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322662912 00000100:00100000:1.0:1788813109.920143:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322662912 00000100:00100000:1.0:1788813109.920191:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788813109.920200:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322662912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788813109.920232:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813109.920268:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322662912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813109.920274:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788813109.920297:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322663168:0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.920324:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813109.920345:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788813109.920352:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322663296:0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.920371:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788813109.920395:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813109.920409:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322663168 00000100:00100000:1.0:1788813109.920413:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322663168 00000100:00100000:1.0:1788813109.920437:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322663296 00000100:00100000:1.0:1788813109.920439:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322663296 00000100:00100000:1.0:1788813109.920476:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788813109.920482:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322663168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.920516:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322663168:12345-0@lo:400:kworker.0 Request processed in 35us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813109.920523:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788813109.920544:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788813109.920550:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322663296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.920577:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322663296:12345-0@lo:400:kworker.0 Request processed in 27us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813109.920582:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788813109.920613:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322663040:0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.920640:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813109.920666:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1875706322663552:0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.920687:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813109.920705:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813109.920711:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322663424:0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.920732:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813109.920756:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322663040 00000100:00100000:1.0:1788813109.920759:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322663040 00000100:00100000:1.0:1788813109.920816:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788813109.920823:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3302:x1875706322663040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.920854:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3302:x1875706322663040:12345-0@lo:400:kworker.0 Request processed in 32us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813109.920859:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788813109.920893:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322663552 00000100:00100000:1.0:1788813109.920897:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322663552 00000100:00100000:1.0:1788813109.920919:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788813109.920925:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875706322663552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.920950:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875706322663552:12345-0@lo:400:kworker.0 Request processed in 26us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813109.920956:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788813109.920979:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322663424 00000100:00100000:1.0:1788813109.920983:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322663424 00000100:00100000:1.0:1788813109.921006:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788813109.921011:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322663424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.921038:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322663424:12345-0@lo:400:kworker.0 Request processed in 27us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813109.921045:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1788813109.921063:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788813109.921066:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813109.921088:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322663296:0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.921098:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322663168:0@lo:400:kworker.0 00010000:00080000:1.0:1788813109.921125:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef35f2d880 x1875706322662912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813125 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813109.921141:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322662912:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788813109.921158:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef35730a80 x1875706322663424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813109.921167:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322663424:0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.921174:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322663040:0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.921182:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1875706322663552:0@lo:400:kworker.0 00000100:00100000:1.0:1788813109.925927:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813109.925952:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322663680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813109.926020:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813109.926117:0:10074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322663680 00000100:00100000:2.0:1788813109.926124:0:10074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322663680 00000100:00100000:2.0:1788813109.926173:0:10074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788813109.926181:0:10074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322663680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813109.926214:0:10074:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813109.926254:0:10074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322663680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813109.926261:0:10074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788813109.926389:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef35f2d880 x1875706322663680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813125 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813109.926422:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322663680:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788813110.254685:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813111.262032:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788813111.523892:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64 00000020:00000080:0.0:1788813111.523902:0:7632:0:(genops.c:885:class_export_put()) final put ffff93ef21252000/d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64 00000020:00000080:2.0:1788813111.525572:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef21252000/d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64 for lustre-OST0001 00000020:00000080:2.0:1788813111.529063:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93ef21256000 for lustre-OST0001 00000100:00100000:1.0:1788813112.277552:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813112.277623:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307950592 00000100:00100000:0.0:1788813112.277632:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307950592 00000100:00100000:0.0:1788813112.277690:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 226 00000100:00100000:0.0:1788813112.277699:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+13:2365:x1875706307950592:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813112.277764:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+13:2365:x1875706307950592:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 67us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813112.277771:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 226 00010000:00010000:0.0:1788813112.285087:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813112.289683:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813112.289724:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813112.289837:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307950720 00000100:00100000:1.0:1788813112.289847:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307950720 00000100:00100000:1.0:1788813112.289916:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307950848 00000100:00100000:1.0:1788813112.289920:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307950848 00000100:00100000:1.0:1788813112.289951:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:1.0:1788813112.289962:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2365:x1875706307950720:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813112.290035:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2365:x1875706307950720:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 75us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813112.290043:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:1.0:1788813112.290063:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:1.0:1788813112.290069:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2366:x1875706307950848:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813112.290096:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2366:x1875706307950848:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 28us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813112.290102:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00080000:0.0:1788813112.290278:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788813113.309145:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813114.334613:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788813114.979165:0:11012:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788813115.038698:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322663808:0@lo:400:kworker.0 00000100:00100000:0.0:1788813115.038770:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813115.038825:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1875706322664320:0@lo:400:kworker.0 00000100:00100000:0.0:1788813115.038860:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813115.038891:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788813115.038898:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36eca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322664192:0@lo:400:kworker.0 00000100:00100000:0.0:1788813115.038924:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813115.038957:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322663936:0@lo:400:kworker.0 00000100:00100000:0.0:1788813115.038980:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813115.038998:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322664448:0@lo:400:kworker.0 00000100:00100000:0.0:1788813115.039021:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813115.039040:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788813115.039056:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322664064:0@lo:400:kworker.0 00000100:00100000:0.0:1788813115.039081:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813115.039116:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322663808 00000100:00100000:0.0:1788813115.039123:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322663808 00000100:00100000:2.0:1788813115.039205:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322664576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813115.039238:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813115.039276:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322664576 00000100:00100000:2.0:1788813115.039281:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322664576 00000100:00100000:0.0:1788813115.039684:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788813115.039695:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3300:x1875706322663808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813115.039753:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3300:x1875706322663808:12345-0@lo:400:kworker.0 Request processed in 60us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813115.039760:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788813115.039817:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322664320 00000100:00100000:0.0:1788813115.039822:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322664320 00000100:00100000:0.0:1788813115.039871:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322663936 00000100:00100000:0.0:1788813115.039875:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322663936 00000100:00100000:0.0:1788813115.039894:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322664064 00000100:00100000:0.0:1788813115.039898:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322664064 00000100:00100000:0.0:1788813115.039916:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788813115.039923:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875706322664320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813115.039958:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875706322664320:12345-0@lo:400:kworker.0 Request processed in 36us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813115.039965:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788813115.039981:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788813115.039989:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322663936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813115.040031:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322663936:12345-0@lo:400:kworker.0 Request processed in 43us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813115.040037:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788813115.040055:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788813115.040064:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322664064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813115.040068:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788813115.040080:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322664576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813115.040111:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813115.040114:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322664064:12345-0@lo:400:kworker.0 Request processed in 51us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813115.040123:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788813115.040157:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322664576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813115.040169:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788813115.040212:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322664064:0@lo:400:kworker.0 00000100:00100000:2.0:1788813115.040224:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322663936:0@lo:400:kworker.0 00010000:00080000:2.0:1788813115.040258:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef35f2d500 x1875706322664576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813115.040274:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322664576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813115.041084:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322664192 00000100:00100000:0.0:1788813115.041092:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322664192 00000100:00100000:0.0:1788813115.041186:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322664448 00000100:00100000:0.0:1788813115.041191:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322664448 00000100:00100000:2.0:1788813115.043182:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788813115.043202:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322664192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813115.043287:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322664192:12345-0@lo:400:kworker.0 Request processed in 93us (4363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813115.043295:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788813115.043320:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788813115.043334:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322664448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813115.043372:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322664448:12345-0@lo:400:kworker.0 Request processed in 47us (4351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813115.043377:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1788813115.043421:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef36ecad80 x1875706322664448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813115.043435:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322664448:0@lo:400:kworker.0 00010000:00080000:0.0:1788813115.043607:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef36eca300 x1875706322664192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813115.043617:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36eca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322664192:0@lo:400:kworker.0 00000100:00100000:0.0:1788813115.043629:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322663808:0@lo:400:kworker.0 00000100:00100000:0.0:1788813115.043640:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1875706322664320:0@lo:400:kworker.0 00000100:00080000:0.0:1788813115.043662:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788813115.043666:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788813115.043669:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813115.044194:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813115.044753:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322664704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813115.044818:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813115.044868:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322664704 00000100:00100000:2.0:1788813115.044875:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322664704 00000100:00100000:3.0:1788813115.044966:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788813115.044977:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322664704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813115.045008:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813115.045040:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322664704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813115.045046:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788813115.045261:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef368d3100 x1875706322664704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813115.045291:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322664704:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788813115.359349:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813116.386693:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813117.390563:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813117.390610:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813117.390642:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813117.390733:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307951232 00000100:00100000:0.0:1788813117.390743:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307951232 00000100:00100000:0.0:1788813117.390860:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307951104 00000100:00100000:0.0:1788813117.390864:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307951104 00000100:00100000:0.0:1788813117.390889:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:0.0:1788813117.390899:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2363:x1875706307951232:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813117.390980:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2363:x1875706307951232:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 83us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813117.390988:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:0.0:1788813117.391004:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 89 00000100:00100000:0.0:1788813117.391012:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+6:2363:x1875706307951104:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813117.391052:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+6:2363:x1875706307951104:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 42us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813117.391059:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 89 00000100:00080000:3.0:1788813117.391450:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813117.391654:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307950976 00000100:00100000:1.0:1788813117.391660:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307950976 00000100:00100000:1.0:1788813117.391695:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 228 00000100:00100000:1.0:1788813117.391701:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+13:2363:x1875706307950976:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813117.391740:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+13:2363:x1875706307950976:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 39us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813117.391746:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 228 00010000:00010000:3.0:1788813117.405003:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788813118.200581:0:11160:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb45dc790 20000000:00000080:2.0:1788813118.200605:0:11160:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93ef365b9400 uarg=0000000000000000 20000000:01000000:2.0:1788813118.200652:0:11160:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788813118.200660:0:11160:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788813118.200666:0:11160:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788813118.205972:0:11161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788813118.206215:0:11160:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788813118.216244:0:11160:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788813118.216284:0:11160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ef21618c00/0x1b294f297b1ec2bf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813118.216311:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef1164ee00/0x1b294f297b1ec264 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce299d expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813118.216321:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef21618400/0x1b294f297b1ec272 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec26b expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813118.216329:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef4214d000/0x1b294f297b1ec280 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec279 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813118.216335:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef1164e600/0x1b294f297b1ec28e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec287 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813118.216342:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef1164f000/0x1b294f297b1ec2a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce29d5 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813118.216349:0:11160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ef21618c00/0x1b294f297b1ec2bf lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813118.216428:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef1164f000/0x1b294f297b1ec2a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce29d5 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813118.216447:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ef1164f000/0x1b294f297b1ec2a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce29d5 expref: 12 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813118.216464:0:11160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875706322664832:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788813118.216906:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef1164e600/0x1b294f297b1ec28e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ec287 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813118.216916:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ef1164e600/0x1b294f297b1ec28e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ec287 expref: 18 pid: 5829 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813118.216927:0:11160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875706322664960:0@lo:104: 00000100:00100000:2.0:1788813118.216978:0:11160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788813118.217351:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef4214d000/0x1b294f297b1ec280 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ec279 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813118.217361:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ef4214d000/0x1b294f297b1ec280 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ec279 expref: 18 pid: 5827 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813118.217370:0:11160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ecb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875706322665088:0@lo:104: 00000100:00100000:2.0:1788813118.217395:0:11160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788813118.217975:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef21618400/0x1b294f297b1ec272 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ec26b expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813118.217987:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ef21618400/0x1b294f297b1ec272 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ec26b expref: 18 pid: 5829 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813118.218017:0:11160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ecad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875706322665216:0@lo:104: 00000100:00100000:2.0:1788813118.218044:0:11160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813118.221738:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813118.221840:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307951360 00000100:00100000:3.0:1788813118.221850:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307951360 00010000:00010000:3.0:1788813118.221902:0:8439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef1164f000/0x1b294f297b1ec2a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce29d5 expref: 13 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813118.221947:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:3.0:1788813118.221958:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef121e4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2aa2133f-e434-4510-82b0-9799a685adfa+13:2365:x1875706307951360:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813118.221976:0:8439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813118.221984:0:8439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef1164f000/0x1b294f297b1ec2a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce29d5 expref: 13 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813118.221998:0:8439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef1164f000/0x1b294f297b1ec2a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce29d5 expref: 13 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813118.222024:0:8439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813118.222088:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef121e4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2aa2133f-e434-4510-82b0-9799a685adfa+13:2365:x1875706307951360:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 132us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813118.222096:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:1.0:1788813118.223465:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322664960 00000100:00100000:1.0:1788813118.223483:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322664960 00000100:00100000:0.0:1788813118.224357:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322665088 00000100:00100000:0.0:1788813118.224367:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322665088 00000100:00100000:0.0:1788813118.224412:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788813118.224422:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+4:11160:x1875706322664960:12345-0@lo:104: 00010000:00010000:0.0:1788813118.224446:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef21619c00/0x1b294f297b1ec287 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec28e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.224566:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788813118.224572:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+4:11160:x1875706322664960:12345-0@lo:104: Request processed in 152us (7594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813118.224580:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788813118.224603:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788813118.224610:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36eca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:11160:x1875706322665088:12345-0@lo:104: 00010000:00010000:0.0:1788813118.224619:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef1164e000/0x1b294f297b1ec279 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec280 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.224656:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788813118.224662:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36eca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:11160:x1875706322665088:12345-0@lo:104: Request processed in 53us (7267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813118.224668:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788813118.224697:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788813118.224704:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef21619c00/0x1b294f297b1ec287 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec28e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.224734:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619c00 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:0.0:1788813118.224739:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef21619c00/0x1b294f297b1ec287 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ec28e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.224748:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef21619c00/0x1b294f297b1ec287 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ec28e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813118.224754:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef21619c00/0x1b294f297b1ec287 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ec28e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813118.224759:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788813118.224821:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef21619c00/0x1b294f297b1ec287 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec28e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.224839:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813118.224865:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef21619c00/0x1b294f297b1ec287 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec28e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.224872:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef21619c00/0x1b294f297b1ec287 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec28e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.224889:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813118.224893:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef1164e000/0x1b294f297b1ec279 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec280 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.224899:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e000 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:0.0:1788813118.224902:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef1164e000/0x1b294f297b1ec279 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ec280 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.224918:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef1164e000/0x1b294f297b1ec279 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ec280 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813118.224925:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef1164e000/0x1b294f297b1ec279 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ec280 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813118.224930:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788813118.224946:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef1164e000/0x1b294f297b1ec279 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec280 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.224952:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813118.224969:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef1164e000/0x1b294f297b1ec279 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec280 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.224976:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef1164e000/0x1b294f297b1ec279 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec280 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.224997:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813118.224999:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813118.225001:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813118.225008:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813118.225034:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322665344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813118.225078:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813118.225135:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322665472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813118.225158:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813118.225193:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322665344 00000100:00100000:0.0:1788813118.225198:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322665344 00010000:00010000:0.0:1788813118.225219:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef1164e600/0x1b294f297b1ec28e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec287 expref: 19 pid: 5829 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813118.225251:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322665472 00000100:00100000:0.0:1788813118.225255:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322665472 00010000:00010000:0.0:1788813118.225270:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef4214d000/0x1b294f297b1ec280 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec279 expref: 20 pid: 5827 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813118.225288:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788813118.225294:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+20:3300:x1875706322665344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813118.225306:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813118.225311:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef1164e600/0x1b294f297b1ec28e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec287 expref: 20 pid: 5829 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.225322:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef1164e600/0x1b294f297b1ec28e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ec287 expref: 20 pid: 5829 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.225342:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813118.225373:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+20:3300:x1875706322665344:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813118.225379:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788813118.225395:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788813118.225401:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3301:x1875706322665472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813118.225408:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813118.225412:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef4214d000/0x1b294f297b1ec280 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec279 expref: 19 pid: 5827 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.225421:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef4214d000/0x1b294f297b1ec280 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ec279 expref: 19 pid: 5827 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.225430:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813118.225462:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3301:x1875706322665472:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813118.225470:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788813118.225516:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322665472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813118.225544:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322665344:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813118.227871:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef1164ee00/0x1b294f297b1ec264 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce299d expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813118.227899:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ef1164ee00/0x1b294f297b1ec264 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce299d expref: 12 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813118.227917:0:11160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ecaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875706322665600:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788813118.228115:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322665216 00000100:00100000:1.0:1788813118.228125:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322665216 00000100:00100000:1.0:1788813118.228186:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788813118.228196:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:11160:x1875706322665216:12345-0@lo:104: 00010000:00010000:1.0:1788813118.228213:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef00031000/0x1b294f297b1ec26b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec272 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813118.228298:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788813118.228305:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:11160:x1875706322665216:12345-0@lo:104: Request processed in 111us (10261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813118.228313:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788813118.228433:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813118.228442:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef00031000/0x1b294f297b1ec26b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec272 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.228451:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef00031000 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:0.0:1788813118.228456:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef00031000/0x1b294f297b1ec26b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ec272 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.228466:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef00031000/0x1b294f297b1ec26b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ec272 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813118.228475:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef00031000/0x1b294f297b1ec26b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ec272 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813118.228482:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788813118.228525:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef00031000/0x1b294f297b1ec26b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec272 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.228532:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813118.228555:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef00031000/0x1b294f297b1ec26b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec272 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.228564:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef00031000/0x1b294f297b1ec26b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec272 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.228605:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813118.228607:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813118.228608:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813118.228623:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322665728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813118.228660:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813118.228712:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322665728 00000100:00100000:0.0:1788813118.228716:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322665728 00010000:00010000:0.0:1788813118.228739:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef21618400/0x1b294f297b1ec272 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec26b expref: 19 pid: 5829 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813118.228763:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788813118.228769:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3302:x1875706322665728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813118.228803:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813118.228810:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef21618400/0x1b294f297b1ec272 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec26b expref: 19 pid: 5829 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.228821:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef21618400/0x1b294f297b1ec272 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ec26b expref: 19 pid: 5829 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.228848:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813118.228879:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3302:x1875706322665728:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813118.228885:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788813118.228929:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322665728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813118.229184:0:11160:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1a1620c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788813118.229205:0:11160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef1164f000/0x1b294f297b1ec2a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce29d5 expref: 12 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813118.229218:0:11160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875706322664832:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788813118.229228:0:11160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef1164e600/0x1b294f297b1ec28e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ec287 expref: 18 pid: 5829 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813118.229236:0:11160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875706322664960:0@lo:104: 00010000:00010000:2.0:1788813118.229246:0:11160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef4214d000/0x1b294f297b1ec280 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ec279 expref: 17 pid: 5827 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813118.229253:0:11160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ecb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875706322665088:0@lo:104: 00010000:00010000:2.0:1788813118.229261:0:11160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef21618400/0x1b294f297b1ec272 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ec26b expref: 16 pid: 5829 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813118.229335:0:11160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ecad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875706322665216:0@lo:104: 00000100:00100000:3.0:1788813118.240109:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813118.240217:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307951488 00000100:00100000:0.0:1788813118.240229:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307951488 00010000:00010000:0.0:1788813118.240284:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef1164ee00/0x1b294f297b1ec264 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce299d expref: 12 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813118.240355:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:0.0:1788813118.240366:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2aa2133f-e434-4510-82b0-9799a685adfa+12:2365:x1875706307951488:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813118.240384:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813118.240391:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef1164ee00/0x1b294f297b1ec264 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce299d expref: 12 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.240405:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef1164ee00/0x1b294f297b1ec264 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce299d expref: 12 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.240431:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ef21618c00/0x1b294f297b1ec2bf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.240441:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef21618c00/0x1b294f297b1ec2bf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.240461:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ef21618c00/0x1b294f297b1ec2bf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.240469:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ef21618c00/0x1b294f297b1ec2bf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.240476:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ef21618c00/0x1b294f297b1ec2bf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.240483:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ef21618c00/0x1b294f297b1ec2bf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.240490:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618c00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813118.240495:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ef21618c00/0x1b294f297b1ec2bf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.240511:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ef21618c00/0x1b294f297b1ec2bf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.240523:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ef21618c00/0x1b294f297b1ec2bf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.240535:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813118.240610:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2aa2133f-e434-4510-82b0-9799a685adfa+12:2365:x1875706307951488:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 246us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813118.240618:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00010000:00010000:2.0:1788813118.244086:0:11160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef1164ee00/0x1b294f297b1ec264 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce299d expref: 11 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813118.244142:0:11160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ecaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1875706322665600:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788813118.244191:0:11160:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ef21618c00/0x1b294f297b1ec2bf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813118.244204:0:11160:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ef21618c00/0x1b294f297b1ec2bf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813118.244210:0:11160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ef21618c00/0x1b294f297b1ec2bf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813118.244216:0:11160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef21618c00/0x1b294f297b1ec2bf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813118.433064:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813119.454056:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788813119.580854:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788813119.580862:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ee0532b000 from 7 10000000:01000000:1.0:1788813119.580867:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788813119.580914:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec2c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813119.580927:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec2c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813119.580939:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec2c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813119.580966:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322665856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813119.581033:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813119.581082:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef249bfcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813119.581143:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322665856 00000100:00100000:2.0:1788813119.581151:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322665856 00000100:00100000:2.0:1788813119.581205:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788813119.581214:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:5831:x1875706322665856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813119.581228:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813119.581240:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef21619200/0x1b294f297b1ec2cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec2c6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813119.581263:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef21619200/0x1b294f297b1ec2cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec2c6 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813119.581273:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef21619200/0x1b294f297b1ec2cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec2c6 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813119.581282:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619200, rc 0) 00000100:00100000:2.0:1788813119.581340:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322665856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813119.581348:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788813119.581457:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322665856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813119.581472:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec2c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec2cd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813119.581480:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec2c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec2cd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813119.581529:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322665984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813119.581558:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813119.581590:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef113a90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813119.581632:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322665984 00000100:00100000:1.0:1788813119.581637:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322665984 00000100:00100000:1.0:1788813119.581672:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788813119.581679:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322665984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813119.581949:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322665984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 270us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813119.581956:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788813119.582081:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322665984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813119.582111:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322666112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813119.582146:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813119.582174:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef113a90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813119.582210:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322666112 00000100:00100000:1.0:1788813119.582216:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322666112 00000100:00100000:1.0:1788813119.582246:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788813119.582253:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322666112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813119.582394:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322666112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813119.582400:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788813119.582435:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322666112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788813119.583074:0:11197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788813119.583117:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788813119.583133:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788813119.583141:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec2c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec2cd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813119.583151:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec2c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec2cd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813119.583161:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788813119.583163:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ef197e7800 from 7 10000000:01000000:1.0:1788813119.583166:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788813119.583188:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec2d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813119.583204:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec2d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813119.583214:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec2d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813119.583229:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322666240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813119.583263:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813119.583283:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef249bf3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813119.583299:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322666240 00000100:00100000:1.0:1788813119.583303:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322666240 00000100:00100000:1.0:1788813119.583329:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788813119.583336:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322666240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813119.583345:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813119.583355:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef4214c600/0x1b294f297b1ec2db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec2d4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813119.583373:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef4214c600/0x1b294f297b1ec2db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec2d4 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813119.583382:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef4214c600/0x1b294f297b1ec2db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec2d4 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813119.583390:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef4214c600, rc 0) 00000100:00100000:1.0:1788813119.583420:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322666240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813119.583426:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788813119.583469:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322666240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813119.583482:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec2d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec2db expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813119.583490:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec2d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec2db expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813119.583529:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322666368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813119.583555:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813119.583568:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef249bf3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813119.583579:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322666368 00000100:00100000:1.0:1788813119.583583:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322666368 00000100:00100000:1.0:1788813119.583601:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788813119.583606:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322666368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813119.583833:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322666368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 226us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813119.583840:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788813119.583871:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322666368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813119.583895:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322666496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813119.583927:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813119.583942:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef249bf3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813119.583953:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322666496 00000100:00100000:1.0:1788813119.583956:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322666496 00000100:00100000:1.0:1788813119.583974:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788813119.583979:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322666496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813119.584095:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322666496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813119.584107:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788813119.584140:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322666496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788813119.585648:0:11198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788813119.585810:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788813119.585841:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788813119.585850:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec2d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec2db expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813119.585862:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec2d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec2db expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813119.585871:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788813119.585874:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ef2171d800 from 7 10000000:01000000:1.0:1788813119.585877:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788813119.585904:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214d000/0x1b294f297b1ec2e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813119.585913:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef4214d000/0x1b294f297b1ec2e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813119.585923:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef4214d000/0x1b294f297b1ec2e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813119.585940:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322666624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813119.585986:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813119.586020:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef249bf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813119.586222:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322666624 00000100:00100000:2.0:1788813119.586229:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322666624 00000100:00100000:2.0:1788813119.586272:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788813119.586281:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21325850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322666624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813119.586291:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813119.586303:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef21618200/0x1b294f297b1ec2e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec2e2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813119.586323:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef21618200/0x1b294f297b1ec2e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec2e2 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813119.586333:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef21618200/0x1b294f297b1ec2e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec2e2 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813119.586342:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21618200, rc 0) 00000100:00100000:2.0:1788813119.586377:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21325850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:5831:x1875706322666624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813119.586383:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788813119.586491:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322666624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813119.586504:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef4214d000/0x1b294f297b1ec2e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec2e9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813119.586523:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef4214d000/0x1b294f297b1ec2e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec2e9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813119.586571:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322666752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813119.586597:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813119.587016:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef249bf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813119.587044:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322666752 00000100:00100000:2.0:1788813119.587050:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322666752 00000100:00100000:2.0:1788813119.587110:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788813119.587118:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21327850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:5831:x1875706322666752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813119.587362:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21327850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:5831:x1875706322666752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813119.587378:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788813119.587447:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322666752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813119.587477:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322666880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813119.587511:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813119.587558:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef113a9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813119.587586:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322666880 00000100:00100000:2.0:1788813119.587590:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322666880 00000100:00100000:2.0:1788813119.587619:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788813119.587625:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21326050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:5831:x1875706322666880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813119.587762:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21326050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:5831:x1875706322666880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813119.587769:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788813119.588127:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322666880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788813119.593331:0:11200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788813119.593648:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788813119.593669:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788813119.593680:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214d000/0x1b294f297b1ec2e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec2e9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813119.593693:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef4214d000/0x1b294f297b1ec2e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec2e9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813119.639137:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813119.639286:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307951616 00000100:00100000:1.0:1788813119.639296:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307951616 00000100:00100000:1.0:1788813119.639347:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 238 00000100:00100000:1.0:1788813119.639357:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+11:5600:x1875706307951616:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813119.639372:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813119.639398:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef354fde00/0x1b294f297b1ec2f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x78c59908dfce29ff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813119.639426:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef354fde00/0x1b294f297b1ec2f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce29ff expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813119.639438:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef354fde00/0x1b294f297b1ec2f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce29ff expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813119.639447:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fde00, rc 0) 00000100:00100000:1.0:1788813119.639494:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+12:5600:x1875706307951616:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 139us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813119.639501:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 238 00000100:00100000:0.0:1788813119.646674:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813119.655243:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307951744 00000100:00100000:1.0:1788813119.655257:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307951744 00000100:00100000:1.0:1788813119.655341:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 239 00000100:00100000:1.0:1788813119.655352:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+12:5600:x1875706307951744:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813119.655595:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+12:5600:x1875706307951744:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 245us (8929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813119.655603:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 239 00000100:00100000:1.0:1788813119.665558:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813119.665626:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307951872 00000100:00100000:0.0:1788813119.665635:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307951872 00000100:00100000:0.0:1788813119.665683:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 240 00000100:00100000:0.0:1788813119.665691:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21326c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+12:5600:x1875706307951872:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813119.666045:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21326c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+12:5600:x1875706307951872:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 353us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813119.666053:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 240 00000100:00100000:3.0:1788813119.673607:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813119.674482:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307952000 00000100:00100000:1.0:1788813119.674493:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307952000 00000100:00100000:1.0:1788813119.674547:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 241 00000100:00100000:1.0:1788813119.674557:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+12:5600:x1875706307952000:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813119.674573:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813119.674591:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef354fd000/0x1b294f297b1ec2f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2a06 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813119.674616:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef354fd000/0x1b294f297b1ec2f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a06 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813119.674626:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef354fd000/0x1b294f297b1ec2f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a06 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813119.674635:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fd000, rc 0) 00000100:00100000:1.0:1788813119.674687:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+13:5600:x1875706307952000:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 133us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813119.674693:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 241 00000100:00100000:3.0:1788813119.679037:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813119.679809:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307952128 00000100:00100000:0.0:1788813119.679829:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307952128 00000100:00100000:0.0:1788813119.679891:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 242 00000100:00100000:0.0:1788813119.679902:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21326850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+13:5600:x1875706307952128:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813119.680219:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21326850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+13:5600:x1875706307952128:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 318us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813119.680227:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 242 00000100:00100000:1.0:1788813119.685569:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813119.689984:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307952256 00000100:00100000:0.0:1788813119.689997:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307952256 00000100:00100000:0.0:1788813119.690053:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 243 00000100:00100000:0.0:1788813119.690064:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21325450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+13:5600:x1875706307952256:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813119.690305:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21325450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+13:5600:x1875706307952256:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 242us (4743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813119.690314:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 243 00000100:00100000:0.0:1788813120.158215:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875706322667136:0@lo:400:kworker.0 00000100:00100000:0.0:1788813120.158278:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813120.158328:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322667648:0@lo:400:kworker.0 00000100:00100000:0.0:1788813120.158351:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813120.158378:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788813120.158384:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322667008:0@lo:400:kworker.0 00000100:00100000:0.0:1788813120.158411:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813120.158433:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1875706322667520:0@lo:400:kworker.0 00000100:00100000:0.0:1788813120.158454:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813120.158479:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322667264:0@lo:400:kworker.0 00000100:00100000:0.0:1788813120.158501:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813120.158519:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788813120.158524:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322667392:0@lo:400:kworker.0 00000100:00100000:0.0:1788813120.158543:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813120.158586:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322667008 00000100:00100000:0.0:1788813120.158594:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322667008 00000100:00100000:0.0:1788813120.158636:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788813120.158644:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3300:x1875706322667008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813120.158753:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322667136 00000100:00100000:3.0:1788813120.158758:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322667136 00000100:00100000:3.0:1788813120.158822:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322667520 00000100:00100000:3.0:1788813120.158826:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322667520 00000100:00100000:3.0:1788813120.158851:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322667264 00000100:00100000:3.0:1788813120.158854:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322667264 00000100:00100000:3.0:1788813120.158869:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788813120.158875:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875706322667136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813120.158986:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322667648 00000100:00100000:2.0:1788813120.158991:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322667648 00000100:00100000:2.0:1788813120.159019:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322667392 00000100:00100000:2.0:1788813120.159022:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322667392 00000100:00100000:2.0:1788813120.159040:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788813120.159046:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322667648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813120.159306:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875706322667136:12345-0@lo:400:kworker.0 Request processed in 429us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813120.159322:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788813120.159343:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788813120.159349:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3e33aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875706322667520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813120.159379:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3e33aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875706322667520:12345-0@lo:400:kworker.0 Request processed in 30us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813120.159384:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788813120.159395:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788813120.159400:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3e33a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322667264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813120.159428:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3e33a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322667264:12345-0@lo:400:kworker.0 Request processed in 28us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813120.159433:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1788813120.159463:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788813120.159466:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813120.159469:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813120.159500:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788813120.159509:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322667776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813120.159538:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813120.159562:0:10074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322667776 00000100:00100000:3.0:1788813120.159566:0:10074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322667776 00000100:00100000:3.0:1788813120.159589:0:10074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788813120.159596:0:10074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875706322667776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813120.159621:0:10074:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813120.159657:0:10074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875706322667776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813120.159663:0:10074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788813120.160075:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3300:x1875706322667008:12345-0@lo:400:kworker.0 Request processed in 1429us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813120.160083:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788813120.160232:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788813120.160241:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3e33ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322667392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813120.160287:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3e33ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322667392:12345-0@lo:400:kworker.0 Request processed in 48us (1742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813120.160293:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788813120.160461:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322667648:12345-0@lo:400:kworker.0 Request processed in 1414us (2107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813120.160467:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788813120.160853:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322667904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813120.160892:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788813120.161061:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef368d3480 x1875706322667776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813136 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813120.161083:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322667776:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788813120.161132:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef354c7b80 x1875706322667392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813120.161142:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322667392:0@lo:400:kworker.0 00000100:00100000:3.0:1788813120.161153:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322667264:0@lo:400:kworker.0 00000100:00100000:3.0:1788813120.161180:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322667008:0@lo:400:kworker.0 00000100:00100000:3.0:1788813120.161192:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1875706322667520:0@lo:400:kworker.0 00000100:00100000:3.0:1788813120.161201:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875706322667136:0@lo:400:kworker.0 00010000:00080000:3.0:1788813120.161211:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef354c6300 x1875706322667648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813120.161219:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322667648:0@lo:400:kworker.0 00000100:00100000:1.0:1788813120.165060:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322667904 00000100:00100000:1.0:1788813120.165075:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322667904 00000100:00100000:0.0:1788813120.169867:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788813120.169881:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322667904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813120.169919:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813120.169993:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322667904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (9101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813120.170000:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788813120.170103:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef36ecaa00 x1875706322667904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813136 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813120.170125:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322667904:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788813120.477778:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813121.505869:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788813122.116418:0:11358:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788813122.508300:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813122.508352:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813122.508391:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813122.508647:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307952384 00000100:00100000:1.0:1788813122.508658:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307952384 00000100:00100000:1.0:1788813122.508719:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 245 00000100:00100000:1.0:1788813122.508730:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21325c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+13:2364:x1875706307952384:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813122.508857:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21325c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+13:2364:x1875706307952384:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 128us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813122.508865:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 245 00000100:00100000:2.0:1788813122.512731:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307952640 00000100:00100000:2.0:1788813122.512746:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307952640 00000100:00100000:2.0:1788813122.512903:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307952512 00000100:00100000:2.0:1788813122.512907:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307952512 00000100:00100000:1.0:1788813122.512989:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:1.0:1788813122.513003:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3e338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2364:x1875706307952640:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813122.513088:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3e338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2364:x1875706307952640:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 89us (4735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813122.513096:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00080000:0.0:1788813122.514882:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813122.515158:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00100000:2.0:1788813122.515172:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3e33b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+6:2364:x1875706307952512:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813122.515312:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3e33b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+6:2364:x1875706307952512:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 144us (6920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813122.515321:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 94 00010000:00010000:0.0:1788813122.525595:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813123.550715:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813124.573748:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813125.277958:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813125.277989:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322668032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813125.278092:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813125.278201:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322668032 00000100:00100000:3.0:1788813125.278211:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322668032 00000100:00100000:3.0:1788813125.278474:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788813125.278486:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322668032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813125.278532:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813125.278586:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322668032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813125.278593:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788813125.278633:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788813125.278671:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef368d3480 x1875706322668032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813125.278693:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322668032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813125.279553:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813125.279572:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322668160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813125.279633:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813125.279682:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322668544:0@lo:400:kworker.0 00000100:00100000:0.0:1788813125.279710:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813125.279748:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813125.279759:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322668288:0@lo:400:kworker.0 00000100:00100000:0.0:1788813125.279768:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322668672:0@lo:400:kworker.0 00000100:00100000:2.0:1788813125.279915:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322668544 00000100:00100000:2.0:1788813125.279922:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322668544 00000100:00100000:2.0:1788813125.280122:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788813125.280133:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3e339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322668544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813125.285340:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813125.285440:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322668672 00000100:00100000:0.0:1788813125.285449:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322668672 00000100:00100000:0.0:1788813125.285512:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788813125.285522:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322668672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813125.285594:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322668672:12345-0@lo:400:kworker.0 Request processed in 74us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813125.285602:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788813125.285656:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef35f2d500 x1875706322668672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813125.285670:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322668672:0@lo:400:kworker.0 00000100:00100000:3.0:1788813125.286838:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813125.286919:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3696d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322668800:0@lo:400:kworker.0 00000100:00100000:1.0:1788813125.287084:0:10074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322668160 00000100:00100000:1.0:1788813125.287094:0:10074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322668160 00000100:00100000:1.0:1788813125.287154:0:10074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788813125.287165:0:10074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3e339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322668160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788813125.287381:0:10074:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813125.287466:0:10074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3e339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322668160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 304us (7833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813125.287474:0:10074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788813125.287515:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875706322668416:0@lo:400:kworker.0 00000100:00100000:1.0:1788813125.287559:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813125.287663:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813125.287821:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322668416 00000100:00100000:3.0:1788813125.287827:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322668416 00000100:00100000:3.0:1788813125.287861:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322668800 00000100:00100000:3.0:1788813125.287865:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322668800 00000100:00100000:3.0:1788813125.287888:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788813125.287896:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875706322668416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813125.288141:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788813125.288149:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875706322668800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813125.288330:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875706322668800:12345-0@lo:400:kworker.0 Request processed in 181us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813125.288337:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788813125.288442:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322668288 00000100:00100000:0.0:1788813125.288447:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322668288 00000100:00100000:0.0:1788813125.288482:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788813125.288490:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21327050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3301:x1875706322668288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813125.288532:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21327050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3301:x1875706322668288:12345-0@lo:400:kworker.0 Request processed in 43us (1701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813125.288538:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00010000:00080000:0.0:1788813125.288602:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef36ecad80 x1875706322668160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813125.288626:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322668160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813125.289083:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875706322668416:12345-0@lo:400:kworker.0 Request processed in 1186us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813125.289092:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1788813125.289120:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788813125.289127:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813125.289763:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322668288:0@lo:400:kworker.0 00000100:00100000:3.0:1788813125.289803:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3696d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322668800:0@lo:400:kworker.0 00000100:00100000:0.0:1788813125.290006:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875706322668416:0@lo:400:kworker.0 00000100:00100000:2.0:1788813125.290404:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3e339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322668544:12345-0@lo:400:kworker.0 Request processed in 10270us (10689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813125.290413:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788813125.290607:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322668544:0@lo:400:kworker.0 00010000:00010000:2.0:1788813125.597409:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788813125.721036:0:11457:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 16:32:04 (1788813124) === 00000100:00100000:2.0:1788813125.918083:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813125.918212:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813125.919213:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307952896 00000100:00100000:3.0:1788813125.919225:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307952896 00000100:00100000:3.0:1788813125.919299:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:3.0:1788813125.919308:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3696ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9c560788-da9a-41fd-952d-091d96dace11+6:9689:x1875706307952896:12345-192.168.203.13@tcp:700:mkdir.0 00000100:00100000:3.0:1788813125.919388:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3696ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9c560788-da9a-41fd-952d-091d96dace11+6:9689:x1875706307952896:12345-192.168.203.13@tcp:700:mkdir.0 Request processed in 79us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813125.919395:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00080000:2.0:1788813125.920218:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813125.922214:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813125.922537:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307952768 00000100:00100000:0.0:1788813125.922548:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307952768 00000100:00100000:0.0:1788813125.922604:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307953152 00000100:00100000:0.0:1788813125.922607:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307953152 00000100:00100000:0.0:1788813125.922640:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:0.0:1788813125.922650:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3696dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+7:2365:x1875706307952768:12345-192.168.203.13@tcp:41:mkdir.0 00000004:00000024:0.0:1788813125.922692:0:8565:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788813125.922920:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:3.0:1788813125.922930:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+7:9689:x1875706307953152:12345-192.168.203.13@tcp:36:mkdir.0 00010000:00010000:3.0:1788813125.922967:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813125.923040:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1ec1df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2988 expref: 7 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813125.923058:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:3.0:1788813125.923070:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813125.923367:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec2fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813125.923381:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec2fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813125.923390:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec2fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813125.923427:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec305 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813125.923435:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec305 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813125.923441:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec305 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813125.924570:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788813125.924583:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec2fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813125.924591:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec2fe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813125.924599:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec2fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813125.924606:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164fe00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813125.924610:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec2fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813125.924620:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec2fe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813125.924631:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef077b4700) 00010000:00010000:3.0:1788813125.924634:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813125.924639:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec2fe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813125.924656:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec2fe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813125.924675:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056f00f75 reply state 0000000011efd954 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec305 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813125.924683:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788813125.924811:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+8:9689:x1875706307953152:12345-192.168.203.13@tcp:36:mkdir.0 Request processed in 1880us (2614us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788813125.924818:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:0.0:1788813125.926540:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3696dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+7:2365:x1875706307952768:12345-192.168.203.13@tcp:41:mkdir.0 Request processed in 3884us (8458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813125.926553:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00010000:00010000:0.0:1788813125.931432:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec305 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813125.931455:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec305 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813125.931464:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec305 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813125.931472:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813125.931477:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec305 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813125.931486:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec305 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813125.931511:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93ef077b4100) 00010000:00010000:0.0:1788813125.931514:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813125.931520:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec305 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813125.931547:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec305 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813125.940286:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813125.940398:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307953280 00000100:00100000:2.0:1788813125.940413:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307953280 00000100:00100000:2.0:1788813125.940546:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:2.0:1788813125.940557:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+6:9690:x1875706307953280:12345-192.168.203.13@tcp:101:chmod.0 00010000:00010000:2.0:1788813125.940579:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813125.940604:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ec30c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2a0d expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.940683:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec313 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.940697:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec313 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.940710:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec313 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813125.940753:0:7630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788813125.940825:0:7630:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788813125.940878:0:7630:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec313 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.940905:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ec30c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a0d expref: 8 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.940924:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec313 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a0d expref: 7 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.940933:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef10b7af00) 00010000:00010000:2.0:1788813125.940935:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813125.940939:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21618400, rc 0) 00000100:00100000:2.0:1788813125.941009:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+7:9690:x1875706307953280:12345-192.168.203.13@tcp:101:chmod.0 Request processed in 452us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813125.941016:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:3.0:1788813125.949397:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813125.950285:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307953536 00000100:00100000:0.0:1788813125.950304:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307953536 00000100:00100000:0.0:1788813125.950389:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:0.0:1788813125.950402:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+7:9690:x1875706307953536:12345-192.168.203.13@tcp:36:chmod.0 00010000:00010000:0.0:1788813125.950469:0:8565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813125.950503:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec313 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a0d expref: 7 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813125.950526:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef10b7af00) 00010000:00010000:0.0:1788813125.950539:0:8565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813125.950571:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec31a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813125.950586:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec31a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813125.950597:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec31a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813125.951025:0:8565:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002257cff6 reply state 00000000e31bf4cf transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec31a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813125.951039:0:8565:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788813125.951048:0:8565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788813125.951164:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+8:9690:x1875706307953536:12345-192.168.203.13@tcp:36:chmod.0 Request processed in 764us (1774us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788813125.951184:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00010000:00010000:3.0:1788813125.960204:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec31a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813125.960221:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec31a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813125.960229:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec31a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813125.960236:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef00031000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813125.960241:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec31a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813125.960248:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec31a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813125.960265:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef1a079400) 00010000:00010000:3.0:1788813125.960268:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788813125.960288:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec31a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813125.960294:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec31a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813125.985934:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813125.988638:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307953664 00000100:00100000:2.0:1788813125.988658:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307953664 00000100:00100000:3.0:1788813125.988933:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:3.0:1788813125.988946:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+7:9691:x1875706307953664:12345-192.168.203.13@tcp:101:chown.0 00010000:00010000:3.0:1788813125.988976:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813125.989005:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec321 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2a14 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813125.989089:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f600/0x1b294f297b1ec328 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813125.989106:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f600/0x1b294f297b1ec328 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813125.989132:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f600/0x1b294f297b1ec328 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813125.989176:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788813125.989180:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813125.989233:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f600/0x1b294f297b1ec328 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813125.989273:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec321 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a14 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813125.989297:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f600/0x1b294f297b1ec328 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a14 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813125.989324:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef077b4700) 00010000:00010000:3.0:1788813125.989328:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788813125.989345:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164f600, rc 0) 00000100:00100000:3.0:1788813125.989438:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+8:9691:x1875706307953664:12345-192.168.203.13@tcp:101:chown.0 Request processed in 494us (3520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813125.989446:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:0.0:1788813125.992339:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813125.992439:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307953792 00000100:00100000:2.0:1788813125.992452:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307953792 00000100:00100000:2.0:1788813125.992521:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:2.0:1788813125.992533:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+8:9691:x1875706307953792:12345-192.168.203.13@tcp:101:chown.0 00010000:00010000:2.0:1788813125.992560:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813125.992585:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ec32f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2a1b expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.992671:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec336 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.992721:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec336 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.992738:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec336 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.992761:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec33d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.992777:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec33d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.992832:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec33d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.992942:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec344 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.992951:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.992958:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813125.992997:0:7630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788813125.993001:0:7630:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788813125.993027:0:7630:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.993042:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec336 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.993060:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec336 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.993068:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec336 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.993074:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813125.993080:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec336 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.993089:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec336 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.993105:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef077b4700) 00010000:00010000:2.0:1788813125.993109:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813125.993115:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec336 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.993122:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec336 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.993139:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec33d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.993144:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec33d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.993151:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec33d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.993156:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618400 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813125.993165:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec33d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.993171:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec33d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.993179:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93ef10b7a800) 00010000:00010000:2.0:1788813125.993182:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813125.993191:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec33d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.993198:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec33d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.993381:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ec32f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a1b expref: 10 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.993400:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec344 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a1b expref: 9 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813125.993453:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93ef10b7a700) 00010000:00010000:2.0:1788813125.993456:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813125.993459:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619c00, rc 0) 00000100:00100000:0.0:1788813125.993623:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+9:9691:x1875706307953792:12345-192.168.203.13@tcp:101:chown.0 Request processed in 1081us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813125.993633:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1788813126.003375:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813126.003476:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307954048 00000100:00100000:0.0:1788813126.003485:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307954048 00000100:00100000:0.0:1788813126.003547:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:0.0:1788813126.003556:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+9:9691:x1875706307954048:12345-192.168.203.13@tcp:36:chown.0 00010000:00010000:0.0:1788813126.003869:0:8565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813126.003895:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec344 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a1b expref: 9 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.003915:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93ef10b7a700) 00010000:00010000:0.0:1788813126.003925:0:8565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813126.003951:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec34b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.003964:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec34b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.003973:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec34b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813126.065094:0:8565:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b47e02b reply state 0000000059f0c63c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec34b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813126.065112:0:8565:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788813126.065139:0:8565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000001:00080000:1.0:1788813126.067422:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:2.0:1788813126.067493:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec34b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813126.067505:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec34b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813126.067513:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec34b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813126.067538:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef00030a00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813126.067543:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec34b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813126.067551:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec34b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813126.067567:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93ef1a079b00) 00010000:00010000:2.0:1788813126.067570:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788813126.067574:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec34b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813126.067580:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec34b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813126.067911:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+7:9691:x1875706307954048:12345-192.168.203.13@tcp:36:chown.0 Request processed in 61698us (61888us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788813126.067921:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:2.0:1788813126.083592:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813126.084849:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307954176 00000100:00100000:3.0:1788813126.084862:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307954176 00000100:00100000:3.0:1788813126.084934:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:3.0:1788813126.084944:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3696e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+6:9692:x1875706307954176:12345-192.168.203.13@tcp:101:touch.500 00010000:00010000:3.0:1788813126.084967:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813126.084987:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ec352 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2a22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788813126.086467:0:5834:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1429us 00010000:00010000:0.0:1788813126.107520:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec359 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.107544:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec359 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.107557:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec359 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.107573:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec360 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.107579:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec360 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.109691:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec360 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.111379:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030e00/0x1b294f297b1ec367 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.111547:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030e00/0x1b294f297b1ec367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.111561:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030e00/0x1b294f297b1ec367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813126.111670:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788813126.111682:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788813126.111722:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030e00/0x1b294f297b1ec367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.111736:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec359 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.111744:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec359 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.111750:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec359 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.111757:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef00030a00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813126.111761:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec359 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.111778:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec359 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.111811:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef077b4700) 00010000:00010000:0.0:1788813126.111815:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813126.111821:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec359 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.112387:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec359 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.112473:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec360 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.112479:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec360 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.112500:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec360 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.112506:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef00031000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813126.112509:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec360 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.112516:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec360 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.112526:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93ef1a079500) 00010000:00010000:0.0:1788813126.112528:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813126.112532:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec360 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.112538:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec360 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.112584:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ec352 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a22 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.112677:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030e00/0x1b294f297b1ec367 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a22 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.112683:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93ef1a079800) 00010000:00010000:0.0:1788813126.112685:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788813126.112687:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef00030e00, rc 0) 00000100:00100000:0.0:1788813126.112757:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3696e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+7:9692:x1875706307954176:12345-192.168.203.13@tcp:101:touch.500 Request processed in 27813us (29174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813126.112808:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:2.0:1788813126.117011:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813126.117239:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307954432 00000100:00100000:0.0:1788813126.117250:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307954432 00000100:00100000:0.0:1788813126.117304:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:0.0:1788813126.117316:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3696d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+7:9692:x1875706307954432:12345-192.168.203.13@tcp:101:touch.500 00010000:00010000:0.0:1788813126.117336:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813126.117355:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031c00/0x1b294f297b1ec36e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2a29 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.117737:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec375 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.117752:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec375 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.117764:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec375 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.117808:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030200/0x1b294f297b1ec37c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.117816:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030200/0x1b294f297b1ec37c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.117822:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030200/0x1b294f297b1ec37c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788813126.120327:0:7630:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788813126.120658:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec383 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.120681:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec383 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.120693:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec383 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.120730:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec375 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.120738:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec375 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.120746:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec375 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.120751:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef00030000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813126.120755:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec375 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.120763:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec375 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.120817:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93ef1a079800) 00010000:00010000:0.0:1788813126.120821:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813126.120835:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec375 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.120849:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec375 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813126.120868:0:7630:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037bb2c72 reply state 000000001f7e21b5 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030200/0x1b294f297b1ec37c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813126.120883:0:7630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788813126.120918:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031c00/0x1b294f297b1ec36e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a29 expref: 10 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.120937:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec383 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a29 expref: 9 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.120945:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:0.0:1788813126.120948:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813126.120950:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef00031200, rc 0) 00000100:00100000:0.0:1788813126.121020:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3696d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+10:9692:x1875706307954432:12345-192.168.203.13@tcp:101:touch.500 Request processed in 3706us (4017us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788813126.121033:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00010000:00010000:2.0:1788813126.125467:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030200/0x1b294f297b1ec37c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813126.125539:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030200/0x1b294f297b1ec37c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813126.125547:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030200/0x1b294f297b1ec37c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813126.125553:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef00030200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813126.125558:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030200/0x1b294f297b1ec37c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813126.125565:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030200/0x1b294f297b1ec37c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813126.125594:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xdfab7e5c (ffff93ef1a079100) 00010000:00010000:2.0:1788813126.125598:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813126.125604:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030200/0x1b294f297b1ec37c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813126.125609:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030200/0x1b294f297b1ec37c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813126.139148:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813126.139477:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307954688 00000100:00100000:0.0:1788813126.139488:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307954688 00000100:00100000:0.0:1788813126.139554:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:0.0:1788813126.139565:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3696c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+9:9692:x1875706307954688:12345-192.168.203.13@tcp:36:touch.500 00010000:00010000:0.0:1788813126.139622:0:8565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813126.139649:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec383 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a29 expref: 9 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.139668:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:0.0:1788813126.139678:0:8565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813126.139719:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031c00/0x1b294f297b1ec391 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.139733:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031c00/0x1b294f297b1ec391 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.139755:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031c00/0x1b294f297b1ec391 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813126.139950:0:8565:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e731332b reply state 00000000608e61e2 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031c00/0x1b294f297b1ec391 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813126.139959:0:8565:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788813126.140041:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3696c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+10:9692:x1875706307954688:12345-192.168.203.13@tcp:36:touch.500 Request processed in 478us (902us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788813126.140048:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00010000:00010000:0.0:1788813126.144539:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031c00/0x1b294f297b1ec391 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.144558:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031c00/0x1b294f297b1ec391 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.144566:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031c00/0x1b294f297b1ec391 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.144573:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef00031c00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813126.144578:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031c00/0x1b294f297b1ec391 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.144586:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031c00/0x1b294f297b1ec391 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.144603:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93ef1a079500) 00010000:00010000:0.0:1788813126.144606:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813126.144612:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031c00/0x1b294f297b1ec391 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.144637:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031c00/0x1b294f297b1ec391 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813126.156960:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813126.157443:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307954816 00000100:00100000:0.0:1788813126.157458:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307954816 00000100:00100000:0.0:1788813126.157525:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:0.0:1788813126.157535:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3696f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+9:9692:x1875706307954816:12345-192.168.203.13@tcp:101:touch.500 00010000:00010000:0.0:1788813126.157559:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813126.157581:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031c00/0x1b294f297b1ec398 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2a30 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.157637:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031c00/0x1b294f297b1ec398 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a30 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.157652:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031c00/0x1b294f297b1ec398 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a30 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.157667:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93ef1a079500) 00010000:00010000:0.0:1788813126.157670:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788813126.157673:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef00031c00, rc 0) 00000100:00100000:0.0:1788813126.157749:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3696f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+10:9692:x1875706307954816:12345-192.168.203.13@tcp:101:touch.500 Request processed in 215us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813126.157756:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:1.0:1788813126.170391:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813126.170497:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307954944 00000100:00100000:2.0:1788813126.170511:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307954944 00000100:00100000:2.0:1788813126.170569:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:2.0:1788813126.170577:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2362:x1875706307954944:12345-192.168.203.13@tcp:8:touch.500 00010000:00080000:2.0:1788813126.170606:0:6676:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 9c560788-da9a-41fd-952d-091d96dace11@192.168.203.13@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:2.0:1788813126.170634:0:6676:0:(genops.c:1384:class_connect()) connect: client 9c560788-da9a-41fd-952d-091d96dace11, cookie 0x1b294f297b1ec39f 00002000:00100000:2.0:1788813126.170644:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9c560788-da9a-41fd-952d-091d96dace11/ffff93ef37f8e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788813126.170653:0:6676:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788813126.177347:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788813126.177406:0:6676:0:(import.c:65:import_set_state_nolock()) ffff93ef217b3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813126.177492:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+6:2362:x1875706307954944:12345-192.168.203.13@tcp:8:touch.500 Request processed in 6912us (7114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813126.177504:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:2.0:1788813126.187979:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813126.188118:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307955072 00000100:00100000:0.0:1788813126.188127:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307955072 00000100:00100000:0.0:1788813126.188210:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:0.0:1788813126.188220:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3696d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+6:0:x1875706307955072:12345-192.168.203.13@tcp:2:touch.500 00000100:00080000:2.0:1788813126.189068:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788813126.269458:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:1.0:1788813126.269498:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9c560788-da9a-41fd-952d-091d96dace11 00000100:00100000:0.0:1788813126.270085:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3696d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+5:0:x1875706307955072:12345-192.168.203.13@tcp:2:touch.500 Request processed in 81857us (82106us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788813126.270101:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:2.0:1788813126.274597:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813126.274824:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307955328 00000100:00100000:3.0:1788813126.274837:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307955328 00000100:00100000:3.0:1788813126.274914:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:3.0:1788813126.274927:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3696c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+10:9692:x1875706307955328:12345-192.168.203.13@tcp:35:touch.500 00000100:00100000:3.0:1788813126.275393:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3696c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+11:9692:x1875706307955328:12345-192.168.203.13@tcp:35:touch.500 Request processed in 466us (808us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788813126.275403:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:1.0:1788813126.293708:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813126.294376:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307955456 00000100:00100000:2.0:1788813126.294392:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307955456 00000100:00100000:2.0:1788813126.294479:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:2.0:1788813126.294492:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+11:9693:x1875706307955456:12345-192.168.203.13@tcp:101:rm.0 00010000:00010000:2.0:1788813126.294524:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813126.294570:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ec3a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2a37 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813126.294655:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ec3ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813126.294671:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ec3ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813126.294686:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ec3ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813126.294735:0:7630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788813126.294739:0:7630:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788813126.294847:0:7630:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ec3ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813126.294882:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ec3a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a37 expref: 13 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813126.294904:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ec3ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a37 expref: 12 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813126.294915:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93ef1a079800) 00010000:00010000:2.0:1788813126.294918:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813126.294922:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21618000, rc 0) 00000100:00100000:2.0:1788813126.294995:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+12:9693:x1875706307955456:12345-192.168.203.13@tcp:101:rm.0 Request processed in 505us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813126.295003:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:2.0:1788813126.303753:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813126.304364:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307955712 00000100:00100000:1.0:1788813126.304379:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307955712 00000100:00100000:1.0:1788813126.304453:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:1.0:1788813126.304464:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3696ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+12:9693:x1875706307955712:12345-192.168.203.13@tcp:101:rm.0 00010000:00010000:1.0:1788813126.304493:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813126.304520:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ec3b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2a3e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813126.304642:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788813126.304899:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ec3b4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a3e expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.304917:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef077b4700) 00010000:00010000:1.0:1788813126.304921:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788813126.304928:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ec3b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a3e expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.304944:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fc200, rc 0) 00000100:00100000:1.0:1788813126.305026:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3696ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+13:9693:x1875706307955712:12345-192.168.203.13@tcp:101:rm.0 Request processed in 563us (1288us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1788813126.305035:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:2.0:1788813126.308491:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813126.308739:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307955840 00000100:00100000:1.0:1788813126.308754:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307955840 00000100:00100000:1.0:1788813126.308886:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:1.0:1788813126.308898:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3696f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+13:9693:x1875706307955840:12345-192.168.203.13@tcp:37:rm.0 00000100:00100000:1.0:1788813126.320471:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3696f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+13:9693:x1875706307955840:12345-192.168.203.13@tcp:37:rm.0 Request processed in 11558us (11977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813126.320489:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:2.0:1788813126.327019:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813126.327120:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307956096 00000100:00100000:3.0:1788813126.327134:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307956096 00000100:00100000:3.0:1788813126.327223:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:3.0:1788813126.327235:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef0e7fb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+13:9693:x1875706307956096:12345-192.168.203.13@tcp:35:rm.0 00000100:00100000:3.0:1788813126.327568:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef0e7fb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+14:9693:x1875706307956096:12345-192.168.203.13@tcp:35:rm.0 Request processed in 334us (560us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788813126.327576:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:2.0:1788813126.333000:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813126.333105:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307956352 00000100:00100000:3.0:1788813126.333119:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307956352 00000100:00100000:3.0:1788813126.333204:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:3.0:1788813126.333330:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3696f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+14:9693:x1875706307956352:12345-192.168.203.13@tcp:101:rm.0 00010000:00010000:3.0:1788813126.333361:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813126.333386:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec3c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2a45 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813126.333504:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ec3c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813126.333521:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ec3c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813126.333535:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ec3c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813126.333548:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788813126.334041:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec3c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a45 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813126.334066:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ec3c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a45 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813126.334075:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93ef1a079800) 00010000:00010000:3.0:1788813126.334086:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788813126.334091:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164e200, rc 0) 00000100:00100000:3.0:1788813126.334491:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3696f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+16:9693:x1875706307956352:12345-192.168.203.13@tcp:101:rm.0 Request processed in 1265us (1497us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788813126.334501:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:0.0:1788813126.338372:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813126.338485:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307956480 00000100:00100000:2.0:1788813126.338499:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307956480 00000100:00100000:2.0:1788813126.338597:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:2.0:1788813126.338609:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+16:9693:x1875706307956480:12345-192.168.203.13@tcp:41:rm.0 00000004:00000024:2.0:1788813126.338686:0:7630:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1788813126.338815:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+16:9693:x1875706307956480:12345-192.168.203.13@tcp:41:rm.0 Request processed in 208us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813126.338823:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:3.0:1788813126.341073:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813126.342373:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307956608 00000100:00100000:0.0:1788813126.342390:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307956608 00000100:00100000:1.0:1788813126.347628:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:1.0:1788813126.347673:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+16:9693:x1875706307956608:12345-192.168.203.13@tcp:101:rm.0 00010000:00010000:1.0:1788813126.347704:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813126.347735:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ec3d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2a4c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.347867:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ec3de lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.347901:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ec3de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.347916:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ec3de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.347935:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ec3e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.347942:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ec3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.347949:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ec3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.348080:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ec3ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.348088:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ec3ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.348095:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ec3ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813126.348144:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788813126.348149:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813126.348172:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ec3ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.348358:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ec3ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.348380:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ec3de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.348388:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ec3de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.348395:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ec3de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.348401:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fc400 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813126.348405:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ec3de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.348413:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ec3de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.348426:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93ef1a079800) 00010000:00010000:1.0:1788813126.348429:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813126.348435:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ec3de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.348441:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ec3de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.348456:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ec3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.349426:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ec3e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.349434:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ec3e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.349451:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fdc00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813126.349455:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ec3e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.349463:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ec3e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.349475:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xdfab7e5c (ffff93ef19f1f400) 00010000:00010000:1.0:1788813126.349478:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813126.349481:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ec3e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.349487:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ec3e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.349541:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ec3d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a4c expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.349559:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ec3ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a4c expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.349566:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93ef1a079500) 00010000:00010000:1.0:1788813126.349569:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813126.349572:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fcc00, rc 0) 00000100:00100000:1.0:1788813126.349668:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+17:9693:x1875706307956608:12345-192.168.203.13@tcp:101:rm.0 Request processed in 2013us (8606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813126.349679:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:3.0:1788813126.353368:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813126.353506:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307956864 00000100:00100000:0.0:1788813126.353519:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307956864 00000100:00100000:0.0:1788813126.353595:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:0.0:1788813126.353617:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+17:9693:x1875706307956864:12345-192.168.203.13@tcp:36:rm.0 00010000:00010000:0.0:1788813126.353689:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788813126.353724:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ec3ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a4c expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.353751:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031c00/0x1b294f297b1ec398 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a30 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.353764:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93ef1a079500) 00010000:00010000:0.0:1788813126.353826:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ec3ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a37 expref: 15 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.353839:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93ef1a079800) 00010000:00010000:0.0:1788813126.353842:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813126.353868:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec3f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.353884:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec3f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.353912:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec3f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.353932:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec3fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.353940:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec3fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.353947:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec3fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.354083:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec401 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.354092:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec401 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.354099:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec401 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788813126.355601:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788813126.356578:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 286742794989ns, next at 287742787543ns, rc = 0 00010000:00010000:0.0:1788813126.356696:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec408 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.356715:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec408 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.356727:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec408 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.356756:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec408 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.356764:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec408 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.357510:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec408 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.357577:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813126.357615:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec401 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.357622:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec401 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.357629:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec401 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.357636:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef00030000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813126.357641:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec401 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.357649:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec401 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.357665:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:0.0:1788813126.357668:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788813126.357675:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec401 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.357696:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec401 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.357722:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec3f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.357728:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec3f3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.357734:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec3f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.357740:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef00030a00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813126.357743:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec3f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.357749:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec3f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.357759:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93ef1a079800) 00010000:00010000:0.0:1788813126.357761:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813126.357764:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec3f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813126.357810:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec3f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813126.357824:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abf8f52c reply state 00000000badaedd5 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec3fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813126.357835:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788813126.357966:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+16:9693:x1875706307956864:12345-192.168.203.13@tcp:36:rm.0 Request processed in 4355us (4607us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788813126.357977:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00010000:00010000:3.0:1788813126.359067:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813126.359079:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec408 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813126.359090:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef00031200 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813126.359094:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec408 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813126.359105:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec408 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813126.359275:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:3.0:1788813126.359278:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788813126.359283:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec408 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813126.359289:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec408 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813126.362855:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813126.362867:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813126.362871:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813126.363410:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec3fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813126.363429:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec3fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813126.363437:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec3fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813126.363444:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef00031000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813126.363450:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec3fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813126.363460:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec3fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813126.363514:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xdfab7e5c (ffff93ef1a079000) 00010000:00010000:2.0:1788813126.363518:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813126.363524:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec3fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813126.363531:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031000/0x1b294f297b1ec3fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813126.366137:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813126.366291:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307957120 00000100:00100000:2.0:1788813126.366304:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307957120 00000100:00100000:2.0:1788813126.366452:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:2.0:1788813126.366466:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+15:9693:x1875706307957120:12345-192.168.203.13@tcp:35:rm.0 00000100:00100000:2.0:1788813126.366833:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+16:9693:x1875706307957120:12345-192.168.203.13@tcp:35:rm.0 Request processed in 370us (709us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788813126.366842:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:0.0:1788813126.371983:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813126.372196:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307957376 00000100:00100000:3.0:1788813126.372209:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307957376 00000100:00100000:3.0:1788813126.372290:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:3.0:1788813126.372302:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+16:9693:x1875706307957376:12345-192.168.203.13@tcp:36:rm.0 00010000:00010000:3.0:1788813126.372401:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788813126.372437:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ec3c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a45 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813126.372458:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030e00/0x1b294f297b1ec367 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a22 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813126.372484:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93ef1a079800) 00010000:00010000:3.0:1788813126.372503:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f600/0x1b294f297b1ec328 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a14 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813126.372513:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef077b4700) 00010000:00010000:3.0:1788813126.372520:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813126.372549:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec40f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813126.372564:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec40f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813126.372575:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec40f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813126.372588:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ec416 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813126.372595:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ec416 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813126.372602:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ec416 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813126.373039:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec41d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813126.373049:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec41d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813126.373056:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec41d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813126.378557:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788813126.378994:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec41d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.379010:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec41d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.379019:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec41d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.379027:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813126.379032:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec41d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.379041:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec41d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.379061:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93ef077b4a00) 00010000:00010000:1.0:1788813126.379064:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788813126.379071:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec41d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.379078:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec41d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.379113:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec40f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.379121:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec40f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.379127:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec40f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.379132:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164fe00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813126.379145:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec40f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.379151:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec40f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.379160:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef077b4800) 00010000:00010000:1.0:1788813126.379163:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813126.380307:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec40f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813126.380327:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec40f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788813126.380358:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000853ef826 reply state 00000000142dd4f8 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ec416 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813126.380369:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788813126.383347:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+15:9693:x1875706307957376:12345-192.168.203.13@tcp:36:rm.0 Request processed in 11029us (11358us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788813126.383363:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 31 00010000:00010000:3.0:1788813126.388166:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ec416 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813126.388198:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ec416 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813126.388208:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ec416 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813126.388215:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164ec00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813126.388221:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ec416 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813126.388231:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ec416 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813126.388250:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93ef077b4b00) 00010000:00010000:3.0:1788813126.388254:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813126.388260:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ec416 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813126.388268:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ec416 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813126.621270:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813127.627462:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813127.629130:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813127.632562:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813127.632605:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813127.636576:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307957632 00000100:00100000:0.0:1788813127.636576:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307957888 00000100:00100000:1.0:1788813127.636597:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307957632 00000100:00100000:0.0:1788813127.636604:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307957888 00000100:00100000:0.0:1788813127.636751:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:0.0:1788813127.636778:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2363:x1875706307957888:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813127.637081:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2363:x1875706307957888:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 319us (7960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813127.637090:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00080000:2.0:1788813127.640478:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813127.642475:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307957504 00000100:00100000:0.0:1788813127.642495:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307957504 00000100:00100000:0.0:1788813127.642566:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 247 00000100:00100000:0.0:1788813127.642578:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+13:2363:x1875706307957504:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813127.642674:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+13:2363:x1875706307957504:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 97us (10126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813127.642683:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 247 00000100:00100000:0.0:1788813127.642724:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307957760 00000100:00100000:0.0:1788813127.642729:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307957760 00000100:00100000:0.0:1788813127.642779:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:0.0:1788813127.642803:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+5:2363:x1875706307957760:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813127.642836:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+5:2363:x1875706307957760:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 35us (10229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813127.642842:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00010000:00010000:1.0:1788813127.653741:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813127.653826:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:1.0:1788813127.653850:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+14:2363:x1875706307957632:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813127.653972:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+14:2363:x1875706307957632:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 135us (26587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813127.653981:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 99 00010000:00010000:2.0:1788813128.670907:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813129.692928:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788813130.231526:0:11608:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1788813130.397121:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322669056:0@lo:400:kworker.0 00000100:00100000:0.0:1788813130.397248:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813130.397315:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322669568:0@lo:400:kworker.0 00000100:00100000:0.0:1788813130.397346:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813130.397383:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813130.397390:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322669184:0@lo:400:kworker.0 00000100:00100000:0.0:1788813130.397413:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813130.397449:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322669056 00000100:00100000:0.0:1788813130.397459:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322669056 00000100:00100000:0.0:1788813130.397511:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322669184 00000100:00100000:0.0:1788813130.397515:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322669184 00000100:00100000:0.0:1788813130.397550:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788813130.397559:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322669056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813130.397633:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322669056:12345-0@lo:400:kworker.0 Request processed in 74us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813130.397837:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788813130.397859:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788813130.397866:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322669184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813130.397899:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322669184:12345-0@lo:400:kworker.0 Request processed in 34us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813130.397906:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788813130.397962:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322669184:0@lo:400:kworker.0 00000100:00100000:0.0:1788813130.397974:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322669056:0@lo:400:kworker.0 00000100:00100000:2.0:1788813130.398200:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322669312:0@lo:400:kworker.0 00000100:00100000:2.0:1788813130.398299:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813130.398342:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788813130.398350:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322668928:0@lo:400:kworker.0 00000100:00100000:2.0:1788813130.398380:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813130.398406:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322669440:0@lo:400:kworker.0 00000100:00100000:2.0:1788813130.398430:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788813130.398459:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813130.398525:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322668928 00000100:00100000:2.0:1788813130.398530:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322668928 00000100:00100000:2.0:1788813130.398569:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788813130.398576:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21326450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3301:x1875706322668928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813130.398748:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21326450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3301:x1875706322668928:12345-0@lo:400:kworker.0 Request processed in 161us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813130.398756:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788813130.398825:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322669440 00000100:00100000:2.0:1788813130.398830:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322669440 00000100:00100000:2.0:1788813130.398863:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788813130.398869:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3696c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875706322669440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813130.398903:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3696c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875706322669440:12345-0@lo:400:kworker.0 Request processed in 34us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813130.398909:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1788813130.398927:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813130.398947:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322668928:0@lo:400:kworker.0 00000100:00100000:2.0:1788813130.398959:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322669440:0@lo:400:kworker.0 00000100:00100000:2.0:1788813130.398983:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813130.398994:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3696e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322669696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813130.399024:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813130.399445:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322669568 00000100:00100000:0.0:1788813130.399451:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322669568 00000100:00100000:0.0:1788813130.399495:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322669312 00000100:00100000:0.0:1788813130.399498:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322669312 00000100:00100000:0.0:1788813130.399536:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788813130.399543:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322669568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813130.399591:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322669568:12345-0@lo:400:kworker.0 Request processed in 49us (2245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813130.399598:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788813130.399626:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788813130.399632:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3696ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322669312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813130.399755:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3696ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322669312:12345-0@lo:400:kworker.0 Request processed in 123us (1455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813130.399762:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788813130.400129:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322669696 00000100:00100000:2.0:1788813130.400135:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322669696 00000100:00100000:2.0:1788813130.400168:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788813130.400176:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3696df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322669696:12345-0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1788813130.400500:0:8101:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 290786717161ns, next at 291786714244ns, rc = 0 00002000:00000024:2.0:1788813130.400748:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813130.400842:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3696df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322669696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 666us (1817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813130.400859:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1788813130.400883:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788813130.400888:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813130.400907:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322669824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813130.400948:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788813130.400998:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef36b23100 x1875706322669312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813130.401013:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322669312:0@lo:400:kworker.0 00000100:00100000:2.0:1788813130.401046:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322669824 00000100:00100000:2.0:1788813130.401050:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322669824 00000100:00100000:2.0:1788813130.401075:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788813130.401082:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3696fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322669824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813130.401104:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813130.401137:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3696fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322669824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813130.401144:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1788813130.401168:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ee06d53480 x1875706322669824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813130.401196:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322669824:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788813130.402165:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef3696e680 x1875706322669696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813130.402198:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3696e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322669696:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788813130.402225:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef36ecb480 x1875706322669568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813130.402250:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322669568:0@lo:400:kworker.0 00010000:00010000:2.0:1788813130.717165:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788813131.153286:0:11656:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0ede6a70 20000000:00000080:3.0:1788813131.153303:0:11656:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93ef3690fc00 uarg=0000000000000000 20000000:01000000:3.0:1788813131.153338:0:11656:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788813131.153345:0:11656:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788813131.153350:0:11656:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788813131.154311:0:11657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788813131.154658:0:11656:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1788813131.166036:0:11656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1788813131.166111:0:11656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1788813131.166169:0:11656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1788813131.166196:0:11656:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788813131.166217:0:11656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ef354fce00/0x1b294f297b1ec424 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813131.166234:0:11656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef21619200/0x1b294f297b1ec2cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec2c6 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813131.166242:0:11656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef4214c600/0x1b294f297b1ec2db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec2d4 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813131.166249:0:11656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef21618200/0x1b294f297b1ec2e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec2e2 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813131.166258:0:11656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef354fde00/0x1b294f297b1ec2f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce29ff expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813131.166265:0:11656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef354fd000/0x1b294f297b1ec2f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a06 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813131.166271:0:11656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ef354fce00/0x1b294f297b1ec424 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813131.166308:0:11656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef354fd000/0x1b294f297b1ec2f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a06 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813131.166321:0:11656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ef354fd000/0x1b294f297b1ec2f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a06 expref: 12 pid: 5827 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813131.166473:0:11656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35731180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11656:1875706322669952:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788813131.166710:0:11656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef354fde00/0x1b294f297b1ec2f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce29ff expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813131.166719:0:11656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ef354fde00/0x1b294f297b1ec2f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce29ff expref: 12 pid: 5827 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813131.166726:0:11656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35730700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11656:1875706322670080:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788813131.166773:0:11656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef21618200/0x1b294f297b1ec2e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ec2e2 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813131.166874:0:11656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ef21618200/0x1b294f297b1ec2e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ec2e2 expref: 18 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813131.166883:0:11656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11656:1875706322670208:0@lo:104: 00000100:00100000:1.0:1788813131.167000:0:11656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788813131.167084:0:11656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef4214c600/0x1b294f297b1ec2db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ec2d4 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813131.167093:0:11656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ef4214c600/0x1b294f297b1ec2db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ec2d4 expref: 18 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813131.167102:0:11656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11656:1875706322670336:0@lo:104: 00000100:00100000:1.0:1788813131.167124:0:11656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788813131.167197:0:11656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef21619200/0x1b294f297b1ec2cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ec2c6 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813131.167206:0:11656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93ef21619200/0x1b294f297b1ec2cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ec2c6 expref: 18 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813131.167223:0:11656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11656:1875706322670464:0@lo:104: 00000100:00100000:1.0:1788813131.167252:0:11656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813131.167314:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322670208 00000100:00100000:0.0:1788813131.167331:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322670208 00000100:00100000:0.0:1788813131.167382:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322670336 00000100:00100000:0.0:1788813131.167386:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322670336 00000100:00100000:0.0:1788813131.167407:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788813131.167418:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+4:11656:x1875706322670208:12345-0@lo:104: 00010000:00010000:0.0:1788813131.167431:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef4214d000/0x1b294f297b1ec2e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec2e9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813131.167778:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788813131.167811:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+4:11656:x1875706322670208:12345-0@lo:104: Request processed in 395us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813131.167824:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788813131.167843:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788813131.167850:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:11656:x1875706322670336:12345-0@lo:104: 00010000:00010000:0.0:1788813131.167858:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec2d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec2db expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813131.167932:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788813131.167939:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:11656:x1875706322670336:12345-0@lo:104: Request processed in 90us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813131.167946:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788813131.168195:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322670464 00000100:00100000:2.0:1788813131.168202:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322670464 00010000:00010000:3.0:1788813131.168275:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788813131.168283:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef4214d000/0x1b294f297b1ec2e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec2e9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.168292:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214d000 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:3.0:1788813131.168296:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214d000/0x1b294f297b1ec2e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ec2e9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.168305:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef4214d000/0x1b294f297b1ec2e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ec2e9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813131.168312:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214d000/0x1b294f297b1ec2e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ec2e9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813131.168318:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788813131.168334:0:11656:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef36d8c900 going to sleep for 11 seconds 00010000:00010000:3.0:1788813131.168351:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef4214d000/0x1b294f297b1ec2e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec2e9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813131.168366:0:11656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11656:1875706322670208:0@lo:104: 00010000:00010000:3.0:1788813131.168379:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788813131.168385:0:11656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11656:1875706322670336:0@lo:104: 00010000:00010000:3.0:1788813131.168411:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef4214d000/0x1b294f297b1ec2e2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec2e9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.168419:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef4214d000/0x1b294f297b1ec2e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec2e9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.168436:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813131.168439:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec2d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec2db expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.168444:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214d200 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:3.0:1788813131.168447:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec2d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ec2db expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.168454:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec2d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ec2db expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813131.168460:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec2d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ec2db expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813131.168465:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788813131.168479:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec2d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec2db expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.168485:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788813131.168523:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788813131.168549:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788813131.168556:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3690cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:11656:x1875706322670464:12345-0@lo:104: 00010000:00010000:0.0:1788813131.168565:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec2c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec2cd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.168589:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec2d4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec2db expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.168599:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef4214d200/0x1b294f297b1ec2d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec2db expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813131.168604:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788813131.168614:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3690cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+3:11656:x1875706322670464:12345-0@lo:104: Request processed in 57us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813131.168622:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788813131.168623:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813131.168627:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec2c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ec2cd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.168634:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214cc00 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:3.0:1788813131.168637:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec2c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ec2cd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.168644:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec2c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ec2cd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813131.168651:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec2c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ec2cd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813131.168657:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788813131.168672:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec2c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec2cd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.168679:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813131.168685:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec2c6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec2cd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.168691:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef4214cc00/0x1b294f297b1ec2c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ec2cd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.168706:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813131.168707:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813131.168709:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813131.168729:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322670592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813131.168826:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322670720:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813131.171074:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813131.172713:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813131.172840:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322670848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788813131.172892:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813131.172941:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322670592 00000100:00100000:3.0:1788813131.172948:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322670592 00010000:00010000:3.0:1788813131.172981:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef21618200/0x1b294f297b1ec2e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec2e2 expref: 19 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813131.173008:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322670848 00000100:00100000:3.0:1788813131.173011:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322670848 00010000:00010000:3.0:1788813131.173020:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef21619200/0x1b294f297b1ec2cd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec2c6 expref: 20 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813131.173038:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788813131.173046:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+20:3302:x1875706322670592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788813131.173063:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813131.173068:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef21618200/0x1b294f297b1ec2e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec2e2 expref: 20 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.173078:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef21618200/0x1b294f297b1ec2e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ec2e2 expref: 20 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.173094:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef21618200/0x1b294f297b1ec2e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ec2e2 expref: 20 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.173108:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813131.173138:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3302:x1875706322670592:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813131.173145:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788813131.173172:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788813131.173177:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:3300:x1875706322670848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788813131.173183:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813131.173187:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef21619200/0x1b294f297b1ec2cd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec2c6 expref: 18 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.173195:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef21619200/0x1b294f297b1ec2cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ec2c6 expref: 18 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.173205:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813131.173230:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:3300:x1875706322670848:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813131.173236:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788813131.173273:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322670848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788813131.173296:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322670592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813131.173896:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813131.175591:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322670720 00000100:00100000:3.0:1788813131.175602:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322670720 00010000:00010000:3.0:1788813131.175636:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef4214c600/0x1b294f297b1ec2db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec2d4 expref: 18 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813131.175669:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788813131.175679:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef121e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:3299:x1875706322670720:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813131.175713:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00010000:00010000:3.0:1788813131.175769:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813131.175776:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef4214c600/0x1b294f297b1ec2db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ec2d4 expref: 18 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.175807:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef4214c600/0x1b294f297b1ec2db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ec2d4 expref: 18 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.175902:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef4214c600/0x1b294f297b1ec2db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ec2d4 expref: 18 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.176109:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813131.176167:0:11656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef21619200/0x1b294f297b1ec2cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ec2c6 expref: 17 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813131.176190:0:11656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11656:1875706322670464:0@lo:104: 00000100:00100000:3.0:1788813131.176293:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef121e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:3299:x1875706322670720:12345-0@lo:103:ldlm_bl.0 Request processed in 616us (2397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813131.176302:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788813131.176346:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307958016 00000100:00100000:3.0:1788813131.176350:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307958016 00010000:00010000:3.0:1788813131.176363:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef354fd000/0x1b294f297b1ec2f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a06 expref: 13 pid: 5827 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813131.176385:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:3.0:1788813131.176392:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2aa2133f-e434-4510-82b0-9799a685adfa+13:2365:x1875706307958016:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813131.176401:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813131.176405:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef354fd000/0x1b294f297b1ec2f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a06 expref: 13 pid: 5827 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.176414:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef354fd000/0x1b294f297b1ec2f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a06 expref: 13 pid: 5827 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.176425:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813131.176462:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2aa2133f-e434-4510-82b0-9799a685adfa+13:2365:x1875706307958016:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 71us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813131.176470:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:3.0:1788813131.176594:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322670720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813131.177706:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813131.178360:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307958144 00000100:00100000:3.0:1788813131.178380:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307958144 00010000:00010000:3.0:1788813131.178408:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef354fde00/0x1b294f297b1ec2f0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce29ff expref: 13 pid: 5827 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813131.178441:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:3.0:1788813131.178450:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2aa2133f-e434-4510-82b0-9799a685adfa+13:2366:x1875706307958144:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813131.178527:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813131.178534:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef354fde00/0x1b294f297b1ec2f0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce29ff expref: 13 pid: 5827 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.178545:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef354fde00/0x1b294f297b1ec2f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce29ff expref: 13 pid: 5827 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.178564:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ef354fce00/0x1b294f297b1ec424 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.178571:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef354fce00/0x1b294f297b1ec424 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.178587:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ef354fce00/0x1b294f297b1ec424 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.178595:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ef354fce00/0x1b294f297b1ec424 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.178601:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ef354fce00/0x1b294f297b1ec424 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.178608:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ef354fce00/0x1b294f297b1ec424 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.178613:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fce00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813131.178625:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ef354fce00/0x1b294f297b1ec424 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.178633:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ef354fce00/0x1b294f297b1ec424 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.178642:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ef354fce00/0x1b294f297b1ec424 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813131.178652:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813131.178696:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2aa2133f-e434-4510-82b0-9799a685adfa+13:2366:x1875706307958144:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 247us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813131.178703:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00010000:00010000:0.0:1788813131.180868:0:11656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef354fd000/0x1b294f297b1ec2f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a06 expref: 12 pid: 5827 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813131.180888:0:11656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35731180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11656:1875706322669952:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788813131.180901:0:11656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef354fde00/0x1b294f297b1ec2f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce29ff expref: 11 pid: 5827 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813131.181244:0:11656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35730700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11656:1875706322670080:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788813131.181293:0:11656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ef354fce00/0x1b294f297b1ec424 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813131.181303:0:11656:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ef354fce00/0x1b294f297b1ec424 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813131.181309:0:11656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ef354fce00/0x1b294f297b1ec424 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813131.181315:0:11656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef354fce00/0x1b294f297b1ec424 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788813131.478552:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:3.0:1788813131.478566:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788813131.478598:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:3.0:1788813131.478614:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788813131.478619:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1788813131.478949:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788813131.478967:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322670976:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788813131.479031:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813131.479096:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322670976 00000100:00100000:0.0:1788813131.479103:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322670976 00000100:00100000:0.0:1788813131.479158:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788813131.479168:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322670976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788813131.479205:0:8122:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1788813131.479238:0:8122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9f1f46, atime: 0x6a9f1f46, ctime: 0x6a9f1f46, blocks: 0x1 00010000:00010000:0.0:1788813131.479246:0:8122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d75aa86f/0x1b294f297b1ec42b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813131.479261:0:8122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=291s v=(0 0) 00010000:00010000:0.0:1788813131.479266:0:8122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813131.479272:0:8122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d75aa86f/0x1b294f297b1ec42b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813131.479309:0:8122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d75aa86f/0x1b294f297b1ec42b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813131.479319:0:8122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d75aa86f/0x1b294f297b1ec42b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813131.479326:0:8122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d75aa86f/0x1b294f297b1ec42b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813131.479344:0:8122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788813131.480270:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1875706322670976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1101us (1236us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788813131.480279:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788813131.480312:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813131.480318:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d75aa86f/0x1b294f297b1ec42b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813131.480328:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef00031000 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813131.480332:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d75aa86f/0x1b294f297b1ec42b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813131.480342:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d75aa86f/0x1b294f297b1ec42b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813131.480359:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d75aa86f/0x1b294f297b1ec42b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813131.480375:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d75aa86f/0x1b294f297b1ec42b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813131.480395:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813131.480397:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813131.480399:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788813131.480431:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ef35730700/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788813131.480438:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322670976:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788813131.744168:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788813132.380898:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788813132.380906:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ee0532b000 from 7 10000000:01000000:3.0:1788813132.380911:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788813132.380959:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164ec00/0x1b294f297b1ec432 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813132.380971:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef1164ec00/0x1b294f297b1ec432 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813132.380983:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef1164ec00/0x1b294f297b1ec432 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813132.381007:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322671104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788813132.381200:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813132.381328:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef10a233c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813132.384539:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322671104 00000100:00100000:0.0:1788813132.384554:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322671104 00000100:00100000:0.0:1788813132.384628:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788813132.384639:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07822850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:5831:x1875706322671104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813132.384656:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813132.384678:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef00031000/0x1b294f297b1ec439 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec432 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813132.384708:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef00031000/0x1b294f297b1ec439 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec432 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813132.384720:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef00031000/0x1b294f297b1ec439 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec432 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813132.385470:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef00031000, rc 0) 00000100:00100000:0.0:1788813132.385614:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07822850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322671104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 976us (4413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813132.385622:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788813132.390003:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322671104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813132.390034:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef1164ec00/0x1b294f297b1ec432 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec439 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813132.390047:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef1164ec00/0x1b294f297b1ec432 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec439 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813132.390131:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322671232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813132.390388:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813132.390949:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef10a233c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813132.391396:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322671232 00000100:00100000:2.0:1788813132.391404:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322671232 00000100:00100000:2.0:1788813132.391639:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788813132.391651:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322671232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813132.391990:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322671232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 341us (1601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813132.391998:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788813132.392082:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322671232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813132.392132:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322671360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813132.392209:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813132.392675:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef10a233c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813132.393118:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322671360 00000100:00100000:0.0:1788813132.393127:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322671360 00000100:00100000:0.0:1788813132.393336:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788813132.393345:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322671360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813132.393560:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322671360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 215us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813132.393567:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788813132.394053:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322671360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813132.400833:0:11670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d50380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:11670:1875706322671488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813132.400998:0:11670:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813132.401084:0:11670:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef10a23f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813132.401134:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322671488 00000100:00100000:0.0:1788813132.401141:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322671488 00000100:00100000:0.0:1788813132.401560:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788813132.401682:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:11670:x1875706322671488:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813132.402107:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:11670:x1875706322671488:12345-0@lo:502:llog_process_th.0 Request processed in 537us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813132.402116:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788813132.402232:0:11670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d50380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:11670:1875706322671488:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788813132.402264:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813132.402274:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813132.402276:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788813132.402283:0:11670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93ee0532b000 00000020:00000080:3.0:1788813132.402292:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788813132.402379:0:11670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d50380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:11670:1875706322671616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813132.402419:0:11670:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813132.402450:0:11670:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef10a23f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813132.402526:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322671616 00000100:00100000:1.0:1788813132.402531:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322671616 00000100:00100000:1.0:1788813132.402578:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788813132.402587:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:11670:x1875706322671616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813132.402721:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:11670:x1875706322671616:12345-0@lo:502:llog_process_th.0 Request processed in 135us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813132.402740:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788813132.402889:0:11670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d50380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:11670:1875706322671616:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788813132.402909:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813132.402913:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813132.402915:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788813132.402929:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788813132.403138:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788813132.403153:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788813132.403162:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164ec00/0x1b294f297b1ec432 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec439 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813132.403175:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef1164ec00/0x1b294f297b1ec432 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec439 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813132.403186:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788813132.403188:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ef197e7800 from 7 10000000:01000000:1.0:1788813132.403197:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788813132.403223:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef354fc600/0x1b294f297b1ec440 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813132.403231:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef354fc600/0x1b294f297b1ec440 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813132.403240:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef354fc600/0x1b294f297b1ec440 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813132.403254:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322671744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813132.403284:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813132.403314:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef36d8c240 going to sleep for 11 seconds 00000100:00100000:2.0:1788813132.404327:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322671744 00000100:00100000:2.0:1788813132.404335:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322671744 00000100:00100000:2.0:1788813132.404384:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788813132.404393:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:5831:x1875706322671744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813132.404407:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813132.404421:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef21618200/0x1b294f297b1ec447 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec440 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813132.404446:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef21618200/0x1b294f297b1ec447 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec440 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813132.404457:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef21618200/0x1b294f297b1ec447 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec440 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813132.404479:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21618200, rc 0) 00000100:00100000:2.0:1788813132.404526:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322671744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813132.404533:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788813132.404716:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322671744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813132.404740:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef354fc600/0x1b294f297b1ec440 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec447 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813132.404751:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef354fc600/0x1b294f297b1ec440 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec447 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813132.404843:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322671872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813132.404873:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813132.404901:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef36d8c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788813132.404915:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322671872 00000100:00100000:1.0:1788813132.405009:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322671872 00000100:00100000:1.0:1788813132.405040:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788813132.405046:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef07822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322671872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813132.405275:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef07822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322671872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813132.405751:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788813132.405871:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322671872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813132.405908:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322672000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813132.406036:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813132.406109:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef36d8c240 going to sleep for 11 seconds 00000100:00100000:2.0:1788813132.412754:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322672000 00000100:00100000:2.0:1788813132.412770:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322672000 00000100:00100000:2.0:1788813132.412935:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788813132.412945:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21385050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322672000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813132.413172:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21385050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322672000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (7135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813132.413180:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788813132.413325:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322672000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813132.413559:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:11673:1875706322672128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813132.414836:0:11673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788813132.423206:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788813132.423310:0:11673:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef36d8ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788813132.426760:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322672128 00000100:00100000:3.0:1788813132.426776:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322672128 00000100:00100000:3.0:1788813132.426861:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788813132.426872:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:11673:x1875706322672128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813132.427162:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:11673:x1875706322672128:12345-0@lo:502:llog_process_th.0 Request processed in 291us (12329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813132.427171:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788813132.427239:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:11673:1875706322672128:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788813132.427272:0:11673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813132.427282:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813132.427284:0:11673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788813132.427291:0:11673:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93ef197e7800 00000020:00000080:3.0:1788813132.427294:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788813132.429161:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d50380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:11673:1875706322672256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813132.429235:0:11673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813132.429273:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322672256 00000100:00100000:3.0:1788813132.429280:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322672256 00000100:00100000:3.0:1788813132.429314:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788813132.429328:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21387050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:11673:x1875706322672256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813132.429510:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21387050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:11673:x1875706322672256:12345-0@lo:502:llog_process_th.0 Request processed in 183us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813132.429518:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788813132.429559:0:11673:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef10a23900 going to sleep for 11 seconds 00000100:00100000:3.0:1788813132.430547:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d50380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:11673:1875706322672256:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788813132.431402:0:11673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813132.431411:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813132.431414:0:11673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788813132.431419:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788813132.431633:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788813132.431655:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788813132.431665:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef354fc600/0x1b294f297b1ec440 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec447 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813132.431677:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef354fc600/0x1b294f297b1ec440 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec447 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813132.431688:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788813132.431690:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ef2171d800 from 7 10000000:01000000:1.0:1788813132.431692:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788813132.431732:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef354fda00/0x1b294f297b1ec44e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813132.431741:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef354fda00/0x1b294f297b1ec44e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813132.431751:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef354fda00/0x1b294f297b1ec44e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813132.431814:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322672384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813132.431870:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813132.431902:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef36d8c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813132.432687:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322672384 00000100:00100000:3.0:1788813132.432696:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322672384 00000100:00100000:3.0:1788813132.432747:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788813132.432755:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21387450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:5831:x1875706322672384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813132.432767:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813132.432779:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef1164f600/0x1b294f297b1ec455 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ec44e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813132.432819:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef1164f600/0x1b294f297b1ec455 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ec44e expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813132.432829:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef1164f600/0x1b294f297b1ec455 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ec44e expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813132.432837:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164f600, rc 0) 00000100:00100000:3.0:1788813132.432880:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21387450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:5831:x1875706322672384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813132.432886:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788813132.434828:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322672384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813132.434852:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef354fda00/0x1b294f297b1ec44e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec455 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813132.434863:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef354fda00/0x1b294f297b1ec44e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec455 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813132.434932:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322672512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813132.434986:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813132.435020:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef36d8c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813132.435037:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322672512 00000100:00100000:1.0:1788813132.435042:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322672512 00000100:00100000:1.0:1788813132.435078:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788813132.435086:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:5831:x1875706322672512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813132.435312:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:5831:x1875706322672512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813132.435319:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788813132.435350:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322672512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813132.435373:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322672640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813132.435405:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813132.435419:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef36d8c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813132.435435:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322672640 00000100:00100000:1.0:1788813132.435438:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322672640 00000100:00100000:1.0:1788813132.435456:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788813132.435461:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:5831:x1875706322672640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813132.435660:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:5831:x1875706322672640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 198us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813132.435667:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788813132.435699:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f07e87b1-ea56-4ba9-97bf-449134c6ff58:5831:1875706322672640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813132.435938:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:11676:1875706322672768:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813132.435970:0:11676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813132.435988:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322672768 00000100:00100000:1.0:1788813132.435991:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322672768 00000100:00100000:1.0:1788813132.436010:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788813132.436016:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:11676:x1875706322672768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813132.436133:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:11676:x1875706322672768:12345-0@lo:502:llog_process_th.0 Request processed in 116us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813132.436139:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788813132.436164:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef36d8ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788813132.436175:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:11676:1875706322672768:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788813132.436194:0:11676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813132.436203:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813132.436206:0:11676:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788813132.436213:0:11676:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93ef2171d800 00000020:00000080:1.0:1788813132.436215:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788813132.437922:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b22d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:11676:1875706322672896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813132.437990:0:11676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813132.438036:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef196b6480 going to sleep for 11 seconds 00000100:00100000:3.0:1788813132.438085:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322672896 00000100:00100000:3.0:1788813132.438091:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322672896 00000100:00100000:3.0:1788813132.438139:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788813132.438148:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:11676:x1875706322672896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813132.438339:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:11676:x1875706322672896:12345-0@lo:502:llog_process_th.0 Request processed in 192us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813132.438346:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788813132.438398:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b22d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f07e87b1-ea56-4ba9-97bf-449134c6ff58:11676:1875706322672896:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788813132.438424:0:11676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813132.438431:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813132.438433:0:11676:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788813132.438438:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788813132.438602:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788813132.438621:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788813132.438630:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef354fda00/0x1b294f297b1ec44e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec455 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813132.438641:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef354fda00/0x1b294f297b1ec44e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec455 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813132.750629:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813132.750674:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813132.750823:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307958272 00000100:00100000:3.0:1788813132.750832:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307958272 00000100:00100000:3.0:1788813132.750892:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 264 00000100:00100000:3.0:1788813132.750902:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+11:2364:x1875706307958272:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813132.750986:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+11:2364:x1875706307958272:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 85us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813132.751003:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 264 00000100:00100000:1.0:1788813132.751189:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813132.751227:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813132.751261:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307958400 00000100:00100000:1.0:1788813132.751266:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307958400 00000100:00100000:1.0:1788813132.751299:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307958656 00000100:00100000:1.0:1788813132.751302:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307958656 00000100:00100000:1.0:1788813132.751322:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 103 00000100:00100000:1.0:1788813132.751329:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+5:2364:x1875706307958400:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813132.751364:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+5:2364:x1875706307958400:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 36us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813132.751371:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 103 00000100:00100000:1.0:1788813132.751385:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 104 00000100:00100000:1.0:1788813132.751391:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2364:x1875706307958656:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813132.751421:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2364:x1875706307958656:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 30us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813132.751427:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 104 00000100:00080000:3.0:1788813132.751644:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813132.752089:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307958528 00000100:00100000:0.0:1788813132.752107:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307958528 00000100:00100000:0.0:1788813132.752199:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:0.0:1788813132.752208:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+5:2364:x1875706307958528:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813132.752259:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+5:2364:x1875706307958528:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 53us (1585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813132.752266:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00080000:3.0:1788813132.752656:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788813132.765307:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813133.002692:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813133.002924:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307958784 00000100:00100000:0.0:1788813133.002934:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307958784 00000100:00100000:0.0:1788813133.002992:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 265 00000100:00100000:0.0:1788813133.003002:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+11:5600:x1875706307958784:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813133.003017:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813133.003034:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef00030e00/0x1b294f297b1ec45c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2a53 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813133.003063:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef00030e00/0x1b294f297b1ec45c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a53 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813133.003076:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef00030e00/0x1b294f297b1ec45c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a53 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813133.003085:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef00030e00, rc 0) 00000100:00100000:0.0:1788813133.003150:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+12:5600:x1875706307958784:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 149us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813133.003158:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 265 00000100:00100000:2.0:1788813133.006626:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813133.006704:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307958912 00000100:00100000:3.0:1788813133.006713:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307958912 00000100:00100000:3.0:1788813133.006803:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 266 00000100:00100000:3.0:1788813133.006814:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+12:5600:x1875706307958912:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813133.007095:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+12:5600:x1875706307958912:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 282us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813133.007110:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 266 00000100:00100000:3.0:1788813133.008860:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813133.013360:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307959040 00000100:00100000:2.0:1788813133.013376:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307959040 00000100:00100000:2.0:1788813133.013519:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 267 00000100:00100000:2.0:1788813133.013531:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+12:5600:x1875706307959040:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813133.013777:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+12:5600:x1875706307959040:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 247us (4923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813133.013802:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 267 00000100:00100000:1.0:1788813133.020934:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813133.021777:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307959168 00000100:00100000:0.0:1788813133.021812:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307959168 00000100:00100000:0.0:1788813133.021880:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 268 00000100:00100000:0.0:1788813133.021904:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+12:9963:x1875706307959168:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788813133.022164:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+12:9963:x1875706307959168:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 262us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813133.022173:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 268 00000100:00100000:1.0:1788813133.039318:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813133.039531:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307959296 00000100:00100000:2.0:1788813133.039542:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307959296 00000100:00100000:2.0:1788813133.039599:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 269 00000100:00100000:2.0:1788813133.039609:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+12:9963:x1875706307959296:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788813133.039910:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+12:9963:x1875706307959296:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 301us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813133.039924:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 269 00000100:00100000:2.0:1788813133.045909:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813133.046030:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307959424 00000100:00100000:3.0:1788813133.046040:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307959424 00000100:00100000:3.0:1788813133.046094:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 270 00000100:00100000:3.0:1788813133.046103:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+12:5600:x1875706307959424:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813133.046120:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813133.046138:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef1164e200/0x1b294f297b1ec463 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2a5a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813133.046167:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef1164e200/0x1b294f297b1ec463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a5a expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813133.046178:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef1164e200/0x1b294f297b1ec463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a5a expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813133.046186:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164e200, rc 0) 00000100:00100000:3.0:1788813133.046248:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+13:5600:x1875706307959424:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 145us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813133.046255:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 270 00000100:00100000:3.0:1788813133.052309:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813133.052533:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307959552 00000100:00100000:1.0:1788813133.052549:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307959552 00000100:00100000:1.0:1788813133.052623:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 271 00000100:00100000:1.0:1788813133.052633:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+13:5600:x1875706307959552:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813133.052968:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+13:5600:x1875706307959552:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 335us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813133.052976:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 271 00000100:00100000:1.0:1788813133.058829:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813133.059044:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307959680 00000100:00100000:2.0:1788813133.059059:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307959680 00000100:00100000:2.0:1788813133.059169:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 272 00000100:00100000:2.0:1788813133.059182:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+13:5600:x1875706307959680:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813133.059719:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+13:5600:x1875706307959680:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 538us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813133.059737:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 272 00000100:00100000:2.0:1788813133.063048:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813133.063367:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307959808 00000100:00100000:3.0:1788813133.063382:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307959808 00000100:00100000:3.0:1788813133.063891:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 273 00000100:00100000:3.0:1788813133.063907:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+13:9966:x1875706307959808:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788813133.064522:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+13:9966:x1875706307959808:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 616us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813133.064542:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 273 00000100:00100000:3.0:1788813133.074799:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813133.075855:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307959936 00000100:00100000:2.0:1788813133.075873:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307959936 00000100:00100000:2.0:1788813133.076048:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 274 00000100:00100000:2.0:1788813133.076061:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+13:9966:x1875706307959936:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788813133.076405:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+13:9966:x1875706307959936:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 345us (1969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813133.076414:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 274 00000040:00080000:0.0:1788813133.469422:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788813133.790674:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813134.813061:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813135.517062:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813135.517084:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322673152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813135.517152:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813135.517225:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322673152 00000100:00100000:3.0:1788813135.517243:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322673152 00000100:00100000:3.0:1788813135.517297:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788813135.517305:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875706322673152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813135.517338:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813135.517381:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875706322673152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813135.517388:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1788813135.517407:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813135.517437:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322673152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813135.517634:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813135.517645:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3696e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322673024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813135.517677:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813135.517737:0:10074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322673024 00000100:00100000:1.0:1788813135.517740:0:10074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322673024 00000100:00100000:1.0:1788813135.517808:0:10074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788813135.517816:0:10074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322673024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788813135.517835:0:10074:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813135.517866:0:10074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322673024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813135.517871:0:10074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1788813135.517897:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef3696e680 x1875706322673024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813151 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813135.517911:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3696e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322673024:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788813135.518181:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813135.518404:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1875706322673536:0@lo:400:kworker.0 00000100:00100000:1.0:1788813135.518433:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813135.518455:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813135.518461:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875706322673408:0@lo:400:kworker.0 00000100:00100000:1.0:1788813135.518483:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813135.518508:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322673536 00000100:00100000:1.0:1788813135.518512:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322673536 00000100:00100000:1.0:1788813135.518541:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322673408 00000100:00100000:1.0:1788813135.518543:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322673408 00000100:00100000:1.0:1788813135.518560:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788813135.518566:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875706322673536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813135.518599:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875706322673536:12345-0@lo:400:kworker.0 Request processed in 33us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813135.518617:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788813135.518629:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788813135.518634:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875706322673408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813135.518656:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875706322673408:12345-0@lo:400:kworker.0 Request processed in 22us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813135.518661:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788813135.518682:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875706322673408:0@lo:400:kworker.0 00000100:00100000:2.0:1788813135.518764:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1875706322673664:0@lo:400:kworker.0 00000100:00100000:2.0:1788813135.518807:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813135.518832:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813135.518837:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322673280:0@lo:400:kworker.0 00000100:00100000:2.0:1788813135.518859:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813135.518882:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322673664 00000100:00100000:2.0:1788813135.518885:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322673664 00000100:00100000:2.0:1788813135.518915:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788813135.518921:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3696ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875706322673664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813135.518954:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3696ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875706322673664:12345-0@lo:400:kworker.0 Request processed in 33us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813135.518959:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788813135.518985:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1875706322673664:0@lo:400:kworker.0 00000100:00080000:3.0:1788813135.519105:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813135.519119:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322673280 00000100:00100000:3.0:1788813135.519122:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322673280 00000100:00100000:3.0:1788813135.519152:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788813135.519158:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3299:x1875706322673280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813135.519194:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3299:x1875706322673280:12345-0@lo:400:kworker.0 Request processed in 36us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813135.519200:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788813135.519269:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322673280:0@lo:400:kworker.0 00000100:00100000:1.0:1788813135.519457:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1875706322673536:0@lo:400:kworker.0 00010000:00010000:2.0:1788813135.838581:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788813136.647950:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:0.0:1788813136.861373:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813137.867530:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813137.867577:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813137.867658:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813137.867704:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813137.867745:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307960192 00000100:00100000:2.0:1788813137.867754:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307960192 00000100:00100000:2.0:1788813137.867832:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307960448 00000100:00100000:2.0:1788813137.867836:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307960448 00000100:00100000:2.0:1788813137.867860:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:2.0:1788813137.867869:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3696c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+5:2364:x1875706307960192:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813137.867933:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3696c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+5:2364:x1875706307960192:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 65us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813137.867941:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:2.0:1788813137.867957:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 109 00000100:00100000:2.0:1788813137.867964:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3696f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2364:x1875706307960448:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813137.867987:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3696f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2364:x1875706307960448:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 23us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813137.868376:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 109 00000100:00100000:3.0:1788813137.868574:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307960064 00000100:00100000:3.0:1788813137.868580:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307960064 00000100:00100000:3.0:1788813137.868625:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 276 00000100:00100000:3.0:1788813137.868632:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+13:2364:x1875706307960064:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813137.868661:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+13:2364:x1875706307960064:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 30us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813137.868667:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 276 00000100:00080000:3.0:1788813137.868700:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813137.869276:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307960320 00000100:00100000:0.0:1788813137.869282:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307960320 00000100:00100000:0.0:1788813137.869337:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:0.0:1788813137.869346:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3696e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+5:2364:x1875706307960320:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813137.869389:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3696e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+5:2364:x1875706307960320:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 44us (1811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813137.869395:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00080000:3.0:1788813137.869548:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788813137.885772:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813138.910425:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813139.933313:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813140.636964:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322673920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813140.637042:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813140.637096:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322673792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813140.637116:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813140.637152:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322674432:0@lo:400:kworker.0 00000100:00100000:0.0:1788813140.637172:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813140.637188:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788813140.637193:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36eca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1875706322674304:0@lo:400:kworker.0 00000100:00100000:0.0:1788813140.637214:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813140.637237:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322674432 00000100:00100000:0.0:1788813140.637256:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322674432 00000100:00100000:0.0:1788813140.637304:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788813140.637313:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322674432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813140.637360:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322674432:12345-0@lo:400:kworker.0 Request processed in 49us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813140.637366:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788813140.637399:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef36ec9180 x1875706322674432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813140.637412:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322674432:0@lo:400:kworker.0 00000100:00100000:2.0:1788813140.637533:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322673920 00000100:00100000:2.0:1788813140.637537:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322673920 00000100:00100000:2.0:1788813140.637566:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322673792 00000100:00100000:2.0:1788813140.637568:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322673792 00000100:00100000:2.0:1788813140.637580:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788813140.637586:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322673920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813140.637612:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813140.637649:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322673920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813140.637656:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788813140.637703:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788813140.637710:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322673792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813140.637728:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813140.637753:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322673792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813140.637758:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788813140.637810:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1788813140.637815:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ef35730700, transno 4294967300 00000100:00100000:2.0:1788813140.637829:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322673920:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788813140.637840:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef36ef6300 x1875706322673792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813156 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813140.637850:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322673792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813140.639766:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3696d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322674048:0@lo:400:kworker.0 00000100:00100000:3.0:1788813140.639869:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813140.639907:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322674560:0@lo:400:kworker.0 00000100:00100000:3.0:1788813140.639933:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813140.639972:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813140.639979:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322674176:0@lo:400:kworker.0 00000100:00100000:3.0:1788813140.639999:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813140.640032:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322674304 00000100:00100000:3.0:1788813140.640040:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322674304 00000100:00100000:3.0:1788813140.640084:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322674560 00000100:00100000:3.0:1788813140.640087:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322674560 00000100:00100000:3.0:1788813140.640107:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322674176 00000100:00100000:3.0:1788813140.640110:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322674176 00000100:00100000:3.0:1788813140.640124:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788813140.640131:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875706322674304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813140.640179:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875706322674304:12345-0@lo:400:kworker.0 Request processed in 48us (2964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813140.640186:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788813140.640213:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788813140.640218:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875706322674560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813140.640247:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875706322674560:12345-0@lo:400:kworker.0 Request processed in 29us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813140.640253:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788813140.640262:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788813140.640267:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322674176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813140.640287:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322674176:12345-0@lo:400:kworker.0 Request processed in 21us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813140.640293:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1788813140.640319:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788813140.640323:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813140.640325:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813140.640348:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322674176:0@lo:400:kworker.0 00000100:00100000:3.0:1788813140.640357:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322674560:0@lo:400:kworker.0 00000100:00100000:3.0:1788813140.640381:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36eca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1875706322674304:0@lo:400:kworker.0 00000100:00100000:0.0:1788813140.640541:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322674048 00000100:00100000:0.0:1788813140.640547:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322674048 00000100:00100000:0.0:1788813140.640589:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788813140.640597:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3301:x1875706322674048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813140.640639:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3301:x1875706322674048:12345-0@lo:400:kworker.0 Request processed in 44us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813140.640645:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788813140.640872:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3696d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322674048:0@lo:400:kworker.0 00010000:00010000:0.0:1788813140.957904:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813141.981050:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813142.987869:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813142.988017:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813142.988069:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813142.988117:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307960576 00000100:00100000:0.0:1788813142.988128:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307960576 00000100:00100000:0.0:1788813142.988190:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 278 00000100:00100000:0.0:1788813142.988201:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+13:2365:x1875706307960576:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813142.988293:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+13:2365:x1875706307960576:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 94us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813142.988301:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 278 00000100:00100000:2.0:1788813142.989825:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813142.989933:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307960832 00000100:00100000:1.0:1788813142.989942:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307960832 00000100:00100000:1.0:1788813142.990018:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:1.0:1788813142.990028:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+5:2365:x1875706307960832:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813142.990096:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+5:2365:x1875706307960832:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 69us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813142.990104:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00080000:2.0:1788813142.990459:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813142.990749:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307960704 00000100:00100000:3.0:1788813142.990758:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307960704 00000100:00100000:3.0:1788813142.990867:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307960960 00000100:00100000:3.0:1788813142.990871:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307960960 00000100:00100000:1.0:1788813142.990932:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:1.0:1788813142.990942:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+5:2366:x1875706307960704:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813142.990990:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+5:2366:x1875706307960704:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 50us (3132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813142.990997:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00080000:2.0:1788813142.994892:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813142.995444:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:3.0:1788813142.995459:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36eca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2366:x1875706307960960:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813142.995626:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36eca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2366:x1875706307960960:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 171us (7555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813142.995648:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 114 00010000:00010000:0.0:1788813143.005560:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788813143.709883:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788813144.029115:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813145.053013:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813145.757295:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef1207d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322675072:0@lo:400:kworker.0 00000100:00100000:1.0:1788813145.757333:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef1207ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1875706322674944:0@lo:400:kworker.0 00000100:00100000:3.0:1788813145.757363:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813145.757363:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813145.757415:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322674688:0@lo:400:kworker.0 00000100:00100000:0.0:1788813145.757480:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322675072 00000100:00100000:0.0:1788813145.757487:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322675072 00000100:00100000:0.0:1788813145.757554:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788813145.757563:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322675072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813145.759382:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee06d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322675456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813145.759497:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813145.759550:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788813145.759557:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef1207fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875706322674816:0@lo:400:kworker.0 00000100:00100000:1.0:1788813145.759583:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813145.759601:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef1207ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322675328:0@lo:400:kworker.0 00000100:00100000:1.0:1788813145.759621:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813145.759671:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322674944 00000100:00100000:1.0:1788813145.759679:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322674944 00000100:00100000:1.0:1788813145.759751:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322674816 00000100:00100000:1.0:1788813145.759755:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322674816 00000100:00100000:1.0:1788813145.759800:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788813145.759809:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875706322674944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813145.759859:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875706322674944:12345-0@lo:400:kworker.0 Request processed in 51us (2496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813145.759866:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788813145.759882:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788813145.759888:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875706322674816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813145.759915:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875706322674816:12345-0@lo:400:kworker.0 Request processed in 27us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813145.759921:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788813145.759938:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322675328 00000100:00100000:1.0:1788813145.759942:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322675328 00000100:00100000:1.0:1788813145.759967:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788813145.759973:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322675328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813145.760004:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322675328:12345-0@lo:400:kworker.0 Request processed in 31us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813145.760009:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788813145.760038:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322675456 00000100:00100000:1.0:1788813145.760042:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322675456 00000100:00100000:1.0:1788813145.760065:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788813145.760071:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322675456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788813145.760110:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813145.760159:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322675456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813145.760165:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788813145.760213:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef1207fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875706322674816:0@lo:400:kworker.0 00000100:00100000:1.0:1788813145.760224:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef1207ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322675328:0@lo:400:kworker.0 00000100:00100000:1.0:1788813145.760232:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef1207ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1875706322674944:0@lo:400:kworker.0 00000100:00100000:1.0:1788813145.760244:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee06d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322675456:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788813145.760627:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788813145.760644:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788813145.760647:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813145.765393:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813145.765417:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322675072:12345-0@lo:400:kworker.0 Request processed in 7851us (8050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813145.765433:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788813145.766401:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322674688 00000100:00100000:1.0:1788813145.766413:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322674688 00000100:00100000:1.0:1788813145.766461:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788813145.766471:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3302:x1875706322674688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813145.766549:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3302:x1875706322674688:12345-0@lo:400:kworker.0 Request processed in 80us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813145.766565:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00010000:00080000:3.0:1788813145.766830:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef1207d880 x1875706322675072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813145.766846:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef1207d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322675072:0@lo:400:kworker.0 00000100:00100000:3.0:1788813145.766882:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322675584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813145.766918:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813145.767384:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322674688:0@lo:400:kworker.0 00000100:00100000:2.0:1788813145.767395:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef1207dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1875706322675200:0@lo:400:kworker.0 00000100:00100000:2.0:1788813145.767428:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813145.767491:0:10074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322675584 00000100:00100000:1.0:1788813145.767503:0:10074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322675584 00000100:00100000:3.0:1788813145.767531:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322675200 00000100:00100000:3.0:1788813145.767537:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322675200 00000100:00100000:1.0:1788813145.767548:0:10074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788813145.767568:0:10074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322675584:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813145.767585:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788813145.767596:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875706322675200:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1788813145.767617:0:10074:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813145.767674:0:10074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322675584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813145.767680:0:10074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1788813145.767698:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788813145.767724:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef36ef4000 x1875706322675584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813145.767740:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322675584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813145.768126:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875706322675200:12345-0@lo:400:kworker.0 Request processed in 532us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813145.768134:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788813145.768757:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef1207dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1875706322675200:0@lo:400:kworker.0 00010000:00010000:3.0:1788813146.077833:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813147.101999:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813148.115712:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813148.116200:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813148.116308:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307961216 00000100:00100000:2.0:1788813148.116322:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307961216 00000100:00100000:2.0:1788813148.116433:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:2.0:1788813148.116446:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+5:2365:x1875706307961216:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813148.116550:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+5:2365:x1875706307961216:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 107us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813148.116557:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00080000:1.0:1788813148.116633:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813148.117364:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307961088 00000100:00100000:0.0:1788813148.117469:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307961088 00000100:00100000:0.0:1788813148.117585:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 280 00000100:00100000:0.0:1788813148.117596:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+13:2365:x1875706307961088:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813148.117667:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+13:2365:x1875706307961088:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 73us (1968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813148.117673:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 280 00010000:00010000:3.0:1788813148.127403:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813148.130772:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813148.131143:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813148.131687:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307961344 00000100:00100000:2.0:1788813148.131711:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307961344 00000100:00100000:2.0:1788813148.131843:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:2.0:1788813148.131867:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+5:2362:x1875706307961344:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:2.0:1788813148.131908:0:6675:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ec39f 00000100:00080000:2.0:1788813148.131919:0:6675:0:(import.c:65:import_set_state_nolock()) ffff93ef217b3800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788813148.131969:0:6675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:0.0:1788813148.133714:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788813148.134576:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813148.134807:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+2:2362:x1875706307961344:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 2944us (3654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813148.134823:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:3.0:1788813148.134949:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307961472 00000100:00100000:3.0:1788813148.134962:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307961472 00000100:00100000:3.0:1788813148.135035:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:3.0:1788813148.135046:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2366:x1875706307961472:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813148.135115:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2366:x1875706307961472:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 71us (4360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813148.135122:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00080000:0.0:1788813148.136071:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788813149.150657:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813150.173131:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813150.877147:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788813150.877186:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef21245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322675712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813150.877208:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef21245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322675840:0@lo:400:kworker.0 00000100:00100000:0.0:1788813150.877253:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813150.877309:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef21245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322676096:0@lo:400:kworker.0 00000100:00100000:0.0:1788813150.877348:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813150.877367:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788813150.877372:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef21244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322676224:0@lo:400:kworker.0 00000100:00100000:0.0:1788813150.877408:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813150.877456:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322675712 00000100:00100000:1.0:1788813150.877667:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813150.877706:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef21247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1875706322676352:0@lo:400:kworker.0 00000100:00100000:0.0:1788813150.877719:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322675712 00000100:00100000:1.0:1788813150.877738:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813150.877757:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788813150.877762:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef21247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322675968:0@lo:400:kworker.0 00000100:00100000:0.0:1788813150.877767:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788813150.877775:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1207e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322675712:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813150.877805:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813150.877823:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef21244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322676480:0@lo:400:kworker.0 00002000:00000024:0.0:1788813150.877829:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813150.877841:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813150.877940:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322676224 00000100:00100000:2.0:1788813150.877945:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322676224 00000100:00100000:2.0:1788813150.877972:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322676480 00000100:00100000:2.0:1788813150.877975:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322676480 00000100:00100000:2.0:1788813150.878000:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788813150.878006:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1207c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1875706322676224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813150.878073:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322676096 00000100:00100000:3.0:1788813150.878078:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322676096 00000100:00100000:3.0:1788813150.878105:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322676352 00000100:00100000:3.0:1788813150.878108:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322676352 00000100:00100000:3.0:1788813150.878127:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322675968 00000100:00100000:3.0:1788813150.878130:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322675968 00000100:00100000:3.0:1788813150.878143:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788813150.878149:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1207d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322676096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813150.884852:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788813150.884873:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322676480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813150.884903:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1207c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1875706322676224:12345-0@lo:400:kworker.0 Request processed in 6894us (7491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813150.884915:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1788813150.884950:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788813150.884957:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813150.884958:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322676480:12345-0@lo:400:kworker.0 Request processed in 92us (7114us total) trans 0 rc 0/0 00000100:00080000:2.0:1788813150.884961:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813150.884969:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788813150.884978:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322675840 00000100:00100000:2.0:1788813150.884988:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322675840 00000100:00100000:1.0:1788813150.885005:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788813150.885016:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875706322676352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813150.885030:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788813150.885039:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3299:x1875706322675840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813150.885055:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875706322676352:12345-0@lo:400:kworker.0 Request processed in 41us (7315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813150.885062:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788813150.885082:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788813150.885087:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3299:x1875706322675840:12345-0@lo:400:kworker.0 Request processed in 47us (7416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813150.885094:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322675968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813150.885099:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788813150.885138:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322675968:12345-0@lo:400:kworker.0 Request processed in 46us (7330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813150.885203:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788813150.885216:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322676608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813150.885247:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813150.885258:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788813150.885282:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322676608 00000100:00100000:2.0:1788813150.885287:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322676608 00000100:00100000:1.0:1788813150.885310:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef21247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322675968:0@lo:400:kworker.0 00000100:00100000:2.0:1788813150.885316:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788813150.885327:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef21244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322676480:0@lo:400:kworker.0 00000100:00100000:2.0:1788813150.885336:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322676608:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813150.885341:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef21245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322675840:0@lo:400:kworker.0 00000100:00100000:1.0:1788813150.885352:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef21247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1875706322676352:0@lo:400:kworker.0 00002000:00000024:2.0:1788813150.885367:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813150.885412:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322676608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813150.885431:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788813150.885820:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322676608:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788813150.885943:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef21244a80 x1875706322676224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813150.885955:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef21244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322676224:0@lo:400:kworker.0 00000100:00100000:3.0:1788813150.886007:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1207d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322676096:12345-0@lo:400:kworker.0 Request processed in 7856us (8656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813150.886015:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788813150.886073:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1207e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322675712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8297us (8818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813150.886081:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788813150.886096:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef21245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322676096:0@lo:400:kworker.0 00010000:00080000:1.0:1788813150.886111:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef21245880 x1875706322675712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813150.886206:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef21245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322675712:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788813151.200410:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788813151.962028:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9c560788-da9a-41fd-952d-091d96dace11 00000020:00000080:2.0:1788813151.962106:0:7632:0:(genops.c:885:class_export_put()) final put ffff93ef37f8e000/9c560788-da9a-41fd-952d-091d96dace11 00000020:00000080:1.0:1788813151.964954:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef37f8e000/9c560788-da9a-41fd-952d-091d96dace11 for lustre-OST0001 00000020:00000080:0.0:1788813151.973179:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93ef217b3800 for lustre-OST0001 00010000:00010000:2.0:1788813152.223069:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813153.230987:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813153.231148:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307961600 00000100:00100000:0.0:1788813153.231159:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307961600 00000100:00100000:0.0:1788813153.231347:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 282 00000100:00100000:0.0:1788813153.231358:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+13:2366:x1875706307961600:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813153.231429:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+13:2366:x1875706307961600:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 73us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813153.231436:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 282 00000100:00100000:3.0:1788813153.239830:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813153.239923:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307961728 00000100:00100000:2.0:1788813153.239932:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307961728 00000100:00100000:2.0:1788813153.240001:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:2.0:1788813153.240013:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+5:2366:x1875706307961728:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813153.240084:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+5:2366:x1875706307961728:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 74us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813153.240092:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00080000:0.0:1788813153.240509:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788813153.245768:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813153.249828:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813153.249906:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307961856 00000100:00100000:0.0:1788813153.249916:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307961856 00000100:00080000:3.0:1788813153.249987:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813153.249993:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00100000:0.0:1788813153.250004:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2365:x1875706307961856:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813153.250079:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2365:x1875706307961856:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 77us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813153.250087:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 124 00000040:00080000:2.0:1788813153.951635:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788813154.272069:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788813155.116852:0:11842:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 16:32:33 (1788813153) 00010000:00010000:3.0:1788813155.293448:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813155.997179:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813155.997209:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322676736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813155.997302:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813155.997398:0:10074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322676736 00000100:00100000:1.0:1788813155.997409:0:10074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322676736 00000100:00100000:1.0:1788813155.997478:0:10074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788813155.997488:0:10074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36160a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322676736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788813155.997531:0:10074:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813155.997591:0:10074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36160a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322676736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813155.997598:0:10074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1788813155.997624:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813155.997663:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322676736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813155.997815:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813155.997828:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322676864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813155.997865:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813155.998194:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322676864 00000100:00100000:0.0:1788813155.998200:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322676864 00000100:00100000:0.0:1788813155.998240:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788813155.998248:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322676864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813155.998290:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813155.998346:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322676864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813155.998353:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1788813155.998386:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef36ec9180 x1875706322676864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813155.998402:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322676864:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788813155.998607:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813155.998773:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322677120:0@lo:400:kworker.0 00000100:00100000:3.0:1788813155.998843:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813155.998868:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813155.998874:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322677248:0@lo:400:kworker.0 00000100:00100000:3.0:1788813155.998914:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813155.998945:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322677120 00000100:00100000:3.0:1788813155.998950:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322677120 00000100:00100000:3.0:1788813155.998981:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322677248 00000100:00100000:3.0:1788813155.998983:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322677248 00000100:00100000:3.0:1788813155.999009:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788813155.999024:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322677120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813155.999065:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322677120:12345-0@lo:400:kworker.0 Request processed in 43us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813155.999073:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788813155.999088:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788813155.999095:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322677248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813155.999120:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322677248:12345-0@lo:400:kworker.0 Request processed in 26us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813155.999127:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:3.0:1788813155.999146:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813155.999165:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322677248:0@lo:400:kworker.0 00000100:00100000:3.0:1788813155.999175:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322677120:0@lo:400:kworker.0 00000100:00100000:2.0:1788813155.999257:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1875706322677376:0@lo:400:kworker.0 00000100:00100000:2.0:1788813155.999308:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813155.999338:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813155.999344:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3696d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322676992:0@lo:400:kworker.0 00000100:00100000:2.0:1788813155.999382:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813155.999419:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322676992 00000100:00100000:2.0:1788813155.999423:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322676992 00000100:00100000:2.0:1788813155.999464:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788813155.999471:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3299:x1875706322676992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813155.999505:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3299:x1875706322676992:12345-0@lo:400:kworker.0 Request processed in 36us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813155.999511:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788813155.999547:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3696d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322676992:0@lo:400:kworker.0 00000100:00100000:0.0:1788813156.000001:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322677376 00000100:00100000:0.0:1788813156.000008:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322677376 00000100:00100000:0.0:1788813156.000061:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788813156.000068:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875706322677376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813156.000125:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875706322677376:12345-0@lo:400:kworker.0 Request processed in 57us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813156.000131:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788813156.000167:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1875706322677376:0@lo:400:kworker.0 00000100:00080000:1.0:1788813156.000231:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788813156.318141:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813156.842929:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813156.843232:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307961984 00000100:00100000:3.0:1788813156.843247:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307961984 00000100:00100000:3.0:1788813156.844804:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:3.0:1788813156.844822:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1207f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+5:10236:x1875706307961984:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813156.844852:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813156.844916:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec46a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2a61 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.844985:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec471 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.845001:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec471 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.845013:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec471 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813156.845079:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788813156.845083:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813156.845121:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec471 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.845145:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec46a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a61 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.845165:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec471 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a61 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.845173:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef077b4600) 00010000:00010000:3.0:1788813156.845176:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788813156.845179:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164ee00, rc 0) 00000100:00100000:3.0:1788813156.845249:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1207f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+6:10236:x1875706307961984:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 434us (2335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813156.845257:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00080000:1.0:1788813156.848922:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813156.862570:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813156.862767:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307962112 00000100:00100000:0.0:1788813156.862777:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307962112 00000100:00100000:0.0:1788813156.862943:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:0.0:1788813156.862955:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+6:10237:x1875706307962112:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813156.862974:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813156.862994:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec478 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2a68 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813156.863903:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec47f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813156.863931:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec47f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813156.863943:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec47f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813156.863960:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec486 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813156.863967:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec486 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813156.863975:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec486 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813156.864470:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031c00/0x1b294f297b1ec48d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813156.864481:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031c00/0x1b294f297b1ec48d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813156.864488:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031c00/0x1b294f297b1ec48d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813156.864516:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788813156.864519:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788813156.864539:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031c00/0x1b294f297b1ec48d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813156.864550:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec47f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813156.864579:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec47f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813156.864585:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec47f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813156.864591:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef00031200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813156.864595:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec47f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813156.864601:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec47f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813156.864612:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef077b4600) 00010000:00010000:0.0:1788813156.864615:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813156.864619:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec47f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813156.864625:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec47f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813156.864636:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec486 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813156.864640:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec486 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813156.864646:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec486 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813156.864650:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef00030000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813156.864656:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec486 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813156.864662:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec486 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813156.865910:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93ef1a079700) 00010000:00010000:0.0:1788813156.865917:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813156.865922:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec486 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813156.865930:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec486 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813156.865982:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec478 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a68 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813156.865997:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031c00/0x1b294f297b1ec48d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a68 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813156.866386:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93ef1a079f00) 00010000:00010000:0.0:1788813156.866389:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788813156.866391:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef00031c00, rc 0) 00000100:00100000:0.0:1788813156.866510:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+7:10237:x1875706307962112:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 3556us (3960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813156.866518:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:0.0:1788813156.877331:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813156.877404:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307962368 00000100:00100000:3.0:1788813156.877415:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307962368 00000100:00100000:3.0:1788813156.877523:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:3.0:1788813156.877534:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1207d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+7:10237:x1875706307962368:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813156.877567:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813156.877590:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec494 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2a6f expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.877665:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec49b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.877691:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec49b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.877703:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec49b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.877742:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec4a2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.877750:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec4a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.877757:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec4a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.878153:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec4a9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.878163:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec4a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.878171:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec4a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813156.878181:0:7630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788813156.878321:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec49b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.878329:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec49b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.878335:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec49b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.878347:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813156.878352:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec49b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.878359:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec49b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.878372:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93ef1a079f00) 00010000:00010000:3.0:1788813156.878374:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813156.878379:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec49b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.878384:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec49b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.878397:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec4a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.878402:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec4a2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.878408:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec4a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.878413:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813156.878416:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec4a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.878422:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec4a2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.878441:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93ef077b4300) 00010000:00010000:3.0:1788813156.878443:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813156.878447:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec4a2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.878453:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec4a2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.878938:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec494 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a6f expref: 10 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.878954:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec4a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a6f expref: 9 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813156.878962:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ef077b4200) 00010000:00010000:3.0:1788813156.878964:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813156.878966:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164fe00, rc 0) 00000100:00100000:3.0:1788813156.879033:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1207d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+9:10237:x1875706307962368:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1500us (1710us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788813156.879041:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:2.0:1788813156.894428:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813156.894579:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307962496 00000100:00100000:3.0:1788813156.894590:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307962496 00000100:00100000:3.0:1788813156.894649:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:3.0:1788813156.894659:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+9:10237:x1875706307962496:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788813156.894831:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+9:10237:x1875706307962496:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 Request processed in 172us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813156.894838:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00000040:00080000:2.0:1788813157.028746:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:0.0:1788813157.126259:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:0.0:1788813157.346283:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813158.349503:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813158.349627:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307962752 00000100:00100000:1.0:1788813158.349636:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307962752 00000100:00100000:1.0:1788813158.349717:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00100000:1.0:1788813158.349726:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1207c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+8:2363:x1875706307962752:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813158.349822:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1207c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+8:2363:x1875706307962752:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 97us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813158.349829:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00080000:0.0:1788813158.349974:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813158.352147:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813158.353076:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307962624 00000100:00100000:3.0:1788813158.353087:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307962624 00000100:00100000:3.0:1788813158.353182:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 284 00000100:00100000:3.0:1788813158.353192:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+13:2364:x1875706307962624:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813158.353267:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+13:2364:x1875706307962624:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 77us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813158.353275:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 284 00000100:00100000:0.0:1788813158.359654:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813158.364223:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307962880 00000100:00100000:3.0:1788813158.364238:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307962880 00000100:00100000:3.0:1788813158.364316:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 129 00000100:00100000:3.0:1788813158.364327:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1207ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2364:x1875706307962880:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813158.364414:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1207ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2364:x1875706307962880:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 88us (4768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813158.364422:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 129 00000100:00080000:0.0:1788813158.365657:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788813158.369838:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813158.984205:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813158.984336:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307963008 00000100:00100000:3.0:1788813158.984345:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307963008 00000100:00100000:3.0:1788813158.984403:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:3.0:1788813158.984413:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+8:10279:x1875706307963008:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813158.984431:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813158.984451:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec4b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2a76 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813158.984511:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec4be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813158.984526:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec4be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813158.984566:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec4be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813158.984582:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec4c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813158.984589:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec4c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813158.984595:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec4c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813158.984818:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec4be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813158.984827:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec4be lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813158.984834:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec4be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813158.984840:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813158.984845:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec4be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813158.984852:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec4be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813158.984865:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef077b4600) 00010000:00010000:3.0:1788813158.984868:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813158.984873:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec4be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813158.984885:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec4be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813158.984897:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec4c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813158.984902:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec4c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813158.984908:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec4c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813158.984913:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813158.984916:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec4c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813158.984922:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec4c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813158.984929:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93ef077b4300) 00010000:00010000:3.0:1788813158.984932:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813158.984934:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec4c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813158.984940:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec4c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813158.984971:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec4b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a76 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813158.984991:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef077b4600) 00010000:00010000:3.0:1788813158.984994:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813158.984998:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec4b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a76 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813158.985009:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164f000, rc 0) 00000100:00100000:3.0:1788813158.985072:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+8:10279:x1875706307963008:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 660us (876us total) trans 0 rc 301/301 00000100:00100000:3.0:1788813158.985081:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:3.0:1788813158.994696:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813158.995308:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307963264 00000100:00100000:0.0:1788813158.995319:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307963264 00000100:00100000:0.0:1788813158.995381:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:0.0:1788813158.995391:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+8:10279:x1875706307963264:12345-192.168.203.13@tcp:36:lfs.0 00010000:00010000:0.0:1788813158.995443:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813158.995469:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec471 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a61 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813158.995487:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef077b4600) 00010000:00010000:0.0:1788813158.995498:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813158.995723:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec4cc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813158.995737:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec4cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813158.995747:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec4cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813158.995760:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec4d3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813158.995767:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec4d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813158.995773:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec4d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813158.998871:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788813158.998892:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec4cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813158.998903:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec4cc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813158.998910:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec4cc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813158.998916:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef00030a00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813158.998920:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec4cc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813158.998927:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec4cc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813158.998941:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef1a079700) 00010000:00010000:0.0:1788813158.998944:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813158.998949:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec4cc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813158.998955:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec4cc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813158.998974:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bf1a367 reply state 000000009a2cc1d0 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec4d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813158.998984:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788813159.000021:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+9:10279:x1875706307963264:12345-192.168.203.13@tcp:36:lfs.0 Request processed in 4626us (5329us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788813159.000041:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00010000:00010000:3.0:1788813159.014145:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec4d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.014174:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec4d3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.014182:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec4d3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.014188:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef00030000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813159.014192:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec4d3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.014201:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec4d3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.014217:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93ef1a079000) 00010000:00010000:3.0:1788813159.014220:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813159.014237:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec4d3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.014244:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec4d3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813159.106321:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813159.106397:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307963392 00000100:00100000:0.0:1788813159.106408:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307963392 00000100:00100000:0.0:1788813159.106466:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:0.0:1788813159.106476:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+8:10287:x1875706307963392:12345-192.168.203.13@tcp:101:lctl.0 00010000:00010000:0.0:1788813159.106499:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813159.106521:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec4da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2a7d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.106593:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec4e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.106617:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec4e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.106629:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec4e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813159.106664:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788813159.106668:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788813159.106706:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec4e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.106730:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec4da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a7d expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.106749:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec4e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a7d expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.106775:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef1a079900) 00010000:00010000:0.0:1788813159.106777:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788813159.106824:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef00031200, rc 0) 00000100:00100000:0.0:1788813159.106885:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+9:10287:x1875706307963392:12345-192.168.203.13@tcp:101:lctl.0 Request processed in 409us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813159.106892:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:1.0:1788813159.163503:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813159.163839:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307963520 00000100:00100000:0.0:1788813159.163848:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307963520 00000100:00100000:0.0:1788813159.163936:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:0.0:1788813159.163947:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+9:10293:x1875706307963520:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788813159.163965:0:8565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813159.163984:0:8565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec4e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2a84 expref: -99 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.164041:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec4ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.164054:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec4ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.164065:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec4ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.164077:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030200/0x1b294f297b1ec4f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.164084:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030200/0x1b294f297b1ec4f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.164108:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030200/0x1b294f297b1ec4f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.164194:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8400/0x1b294f297b1ec4fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.164201:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8400/0x1b294f297b1ec4fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.164208:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8400/0x1b294f297b1ec4fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813159.164235:0:8565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788813159.164238:0:8565:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788813159.164277:0:8565:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8400/0x1b294f297b1ec4fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.164288:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec4ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.164294:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec4ef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.164300:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec4ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.164306:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef00030000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813159.164310:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec4ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.164318:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec4ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.164337:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef1a079900) 00010000:00010000:0.0:1788813159.164340:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813159.164344:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec4ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.164350:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030000/0x1b294f297b1ec4ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.164363:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030200/0x1b294f297b1ec4f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.164367:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030200/0x1b294f297b1ec4f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.164372:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030200/0x1b294f297b1ec4f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.164377:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef00030200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813159.164380:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030200/0x1b294f297b1ec4f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.164386:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030200/0x1b294f297b1ec4f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.164392:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93ef1a079700) 00010000:00010000:0.0:1788813159.164394:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813159.164397:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030200/0x1b294f297b1ec4f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.164403:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030200/0x1b294f297b1ec4f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.164440:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00030a00/0x1b294f297b1ec4e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a84 expref: 11 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.164452:0:8565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8400/0x1b294f297b1ec4fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a84 expref: 10 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.164458:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:0.0:1788813159.164460:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788813159.164462:0:8565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef421e8400, rc 0) 00000100:00100000:0.0:1788813159.164526:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+10:10293:x1875706307963520:12345-192.168.203.13@tcp:101:bash.0 Request processed in 582us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813159.164533:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:3.0:1788813159.168879:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813159.169211:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307963776 00000100:00100000:0.0:1788813159.169221:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307963776 00000100:00100000:0.0:1788813159.169277:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:0.0:1788813159.169287:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+10:10293:x1875706307963776:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788813159.169305:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813159.169325:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec504 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2a8b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.169446:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec50b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.169459:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec50b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.169470:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec50b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.169520:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec512 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.169528:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec512 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.169534:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec512 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788813159.170142:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788813159.170314:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec519 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.170324:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec519 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.170332:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec519 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.170366:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec50b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.170374:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec50b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.170381:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec50b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.170387:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef421e8c00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813159.170391:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec50b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.170410:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec50b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.170422:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:0.0:1788813159.170425:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813159.170430:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec50b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.170436:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec50b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813159.170450:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c273fe5 reply state 00000000338c486a transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec512 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813159.170458:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788813159.170488:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec504 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a8b expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.170502:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec519 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a8b expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.170509:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079b00) 00010000:00010000:0.0:1788813159.170512:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813159.170514:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cee00, rc 0) 00000100:00100000:0.0:1788813159.170765:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+13:10293:x1875706307963776:12345-192.168.203.13@tcp:101:bash.0 Request processed in 1479us (1894us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788813159.170773:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00010000:00010000:3.0:1788813159.174689:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec512 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.174706:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec512 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.174714:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec512 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.174721:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef421e9e00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813159.174725:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec512 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.174733:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec512 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.174748:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ef1a079100) 00010000:00010000:3.0:1788813159.174752:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813159.174756:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec512 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.174763:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec512 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813159.178647:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813159.179212:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307963904 00000100:00100000:1.0:1788813159.179222:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307963904 00000100:00100000:1.0:1788813159.179259:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:1.0:1788813159.179266:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1875706307963904:12345-192.168.203.13@tcp:8:bash.0 00010000:00080000:1.0:1788813159.179296:0:6677:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 9c560788-da9a-41fd-952d-091d96dace11@192.168.203.13@tcp t0 exp 0000000000000000 cur 319 last 0 00000020:00000080:1.0:1788813159.179325:0:6677:0:(genops.c:1384:class_connect()) connect: client 9c560788-da9a-41fd-952d-091d96dace11, cookie 0x1b294f297b1ec527 00002000:00100000:1.0:1788813159.179335:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9c560788-da9a-41fd-952d-091d96dace11/ffff93ef217b2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788813159.179357:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788813159.179586:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788813159.179616:0:6677:0:(import.c:65:import_set_state_nolock()) ffff93ef217b1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813159.179731:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2362:x1875706307963904:12345-192.168.203.13@tcp:8:bash.0 Request processed in 462us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813159.179739:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:2.0:1788813159.185474:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813159.185557:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307964032 00000100:00100000:0.0:1788813159.185577:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307964032 00000100:00100000:0.0:1788813159.185641:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:0.0:1788813159.185651:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36177800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+6:0:x1875706307964032:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788813159.185666:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813159.185687:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba78a70b/0x1b294f297b1ec52e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2a92 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788813159.185714:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813159.185732:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=319s v=(0 0) 00010000:00010000:0.0:1788813159.185736:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813159.185745:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba78a70b/0x1b294f297b1ec52e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a92 expref: 7 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.185765:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba78a70b/0x1b294f297b1ec52e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a92 expref: 7 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.185777:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190ce000, rc 0) 00000100:00100000:0.0:1788813159.185852:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36177800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+7:0:x1875706307964032:12345-192.168.203.13@tcp:101:bash.0 Request processed in 202us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813159.185859:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00080000:1.0:1788813159.186630:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813159.191568:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813159.191806:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307964160 00000100:00100000:0.0:1788813159.191815:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307964160 00000100:00100000:0.0:1788813159.191872:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:0.0:1788813159.191882:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36176d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+7:10293:x1875706307964160:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788813159.191898:0:8122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813159.191914:0:8122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061a3daae/0x1b294f297b1ec535 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2a99 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.191967:0:8122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba78a70b/0x1b294f297b1ec52e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a92 expref: 8 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.191976:0:8122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813159.191980:0:8122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813159.191985:0:8122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061a3daae/0x1b294f297b1ec535 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a99 expref: 8 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.192266:0:8122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba78a70b/0x1b294f297b1ec52e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a92 expref: 8 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.192281:0:8122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba78a70b/0x1b294f297b1ec52e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a92 expref: 8 pid: 6675 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813159.192295:0:8122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef1207f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8122:1875706322677504:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788813159.192417:0:8122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef21238480 going to sleep for 11 seconds 00000100:00100000:0.0:1788813159.200655:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813159.200733:0:8122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef1207f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8122:1875706322677504:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788813159.200766:0:8122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000061a3daae/0x1b294f297b1ec535 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a99 expref: 8 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813159.200805:0:8122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cf800, rc 0) 00000100:00100000:2.0:1788813159.200864:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36176d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+8:10293:x1875706307964160:12345-192.168.203.13@tcp:101:bash.0 Request processed in 8983us (9304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813159.200873:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:3.0:1788813159.201711:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307964288 00000100:00100000:3.0:1788813159.201721:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307964288 00010000:00010000:3.0:1788813159.201753:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba78a70b/0x1b294f297b1ec52e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a92 expref: 8 pid: 6675 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813159.201809:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:3.0:1788813159.201817:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1207f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+8:2365:x1875706307964288:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813159.201830:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813159.201850:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba78a70b/0x1b294f297b1ec52e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a92 expref: 8 pid: 6675 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.201863:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba78a70b/0x1b294f297b1ec52e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a92 expref: 8 pid: 6675 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.201887:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba78a70b/0x1b294f297b1ec52e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a92 expref: 8 pid: 6675 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.201902:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813159.201906:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813159.201913:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061a3daae/0x1b294f297b1ec535 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a99 expref: 7 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.201923:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061a3daae/0x1b294f297b1ec535 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a99 expref: 7 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.201970:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000061a3daae/0x1b294f297b1ec535 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a99 expref: 7 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813159.201997:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36637100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5820:1875706322677632:192.168.203.13@tcp:105: 00000100:00100000:3.0:1788813159.202068:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef12685a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813159.207056:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813159.207098:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36637100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5820:1875706322677632:192.168.203.13@tcp:105: 00010000:00010000:3.0:1788813159.207123:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813159.207179:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1207f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+7:2365:x1875706307964288:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 5362us (6533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813159.207190:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:2.0:1788813159.207339:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307964544 00000100:00100000:2.0:1788813159.207346:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307964544 00000100:00100000:2.0:1788813159.207395:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:2.0:1788813159.207417:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1207ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+12:10293:x1875706307964544:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:2.0:1788813159.207733:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1207ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+13:10293:x1875706307964544:12345-192.168.203.13@tcp:35:bash.0 Request processed in 317us (686us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788813159.207740:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:0.0:1788813159.334673:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813159.334772:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307964800 00000100:00100000:3.0:1788813159.334833:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307964800 00000100:00100000:3.0:1788813159.334907:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:3.0:1788813159.334917:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1207c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+13:10303:x1875706307964800:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813159.334942:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813159.334962:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec53c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2aa0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813159.335048:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788813159.335165:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec53c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2aa0 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.335178:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef1a079900) 00010000:00010000:3.0:1788813159.335181:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813159.335187:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec53c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2aa0 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.335201:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164f000, rc 0) 00000100:00100000:3.0:1788813159.335284:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1207c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+14:10303:x1875706307964800:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 368us (620us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1788813159.335291:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:3.0:1788813159.343286:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813159.344233:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307965056 00000100:00100000:1.0:1788813159.344244:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307965056 00000100:00100000:1.0:1788813159.344311:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1788813159.344321:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+14:10303:x1875706307965056:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1788813159.344701:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+15:10303:x1875706307965056:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 381us (1423us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788813159.344709:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00010000:00010000:0.0:1788813159.389014:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813159.491356:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813159.491467:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307965184 00000100:00100000:0.0:1788813159.491476:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307965184 00000100:00100000:0.0:1788813159.491535:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:0.0:1788813159.491554:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+15:10309:x1875706307965184:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813159.491577:0:8565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813159.491608:0:8565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ec54a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2aa7 expref: -99 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.491687:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec551 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.491701:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec551 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.491713:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec551 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813159.491747:0:8565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788813159.491751:0:8565:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788813159.491768:0:8565:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec551 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.491832:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ec54a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2aa7 expref: 17 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.491851:0:8565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec551 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2aa7 expref: 16 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.491859:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:0.0:1788813159.491861:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788813159.491865:0:8565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cf400, rc 0) 00000100:00100000:0.0:1788813159.491933:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+16:10309:x1875706307965184:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 380us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813159.491940:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:0.0:1788813159.504939:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813159.505077:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307965440 00000100:00100000:1.0:1788813159.505088:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307965440 00000100:00100000:1.0:1788813159.505155:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:1.0:1788813159.505165:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1207e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+16:10309:x1875706307965440:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813159.505185:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813159.505207:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd600/0x1b294f297b1ec558 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2aae expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.505304:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd400/0x1b294f297b1ec55f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.505318:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd400/0x1b294f297b1ec55f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.505329:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd400/0x1b294f297b1ec55f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813159.505341:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788813159.505482:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd600/0x1b294f297b1ec558 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2aae expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.505501:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd400/0x1b294f297b1ec55f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2aae expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.505509:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079b00) 00010000:00010000:1.0:1788813159.505511:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813159.505514:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fd400, rc 0) 00000100:00100000:1.0:1788813159.505587:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1207e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+18:10309:x1875706307965440:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 424us (664us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788813159.505595:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:3.0:1788813159.519746:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813159.520383:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307965568 00000100:00100000:1.0:1788813159.520408:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307965568 00000100:00100000:3.0:1788813159.520567:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:3.0:1788813159.520581:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+18:2365:x1875706307965568:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813159.520596:0:8439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813159.520619:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd400/0x1b294f297b1ec55f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2aae expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.520637:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079b00) 00010000:00010000:3.0:1788813159.520642:0:8439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813159.520703:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+17:2365:x1875706307965568:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 126us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813159.520711:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:2.0:1788813159.528016:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813159.528392:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307965824 00000100:00100000:3.0:1788813159.528403:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307965824 00000100:00100000:3.0:1788813159.528455:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:3.0:1788813159.528464:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+17:10309:x1875706307965824:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813159.528498:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813159.528517:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec56d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2ab5 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.528624:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec574 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.528657:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec574 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.528670:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec574 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813159.528684:0:7630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788813159.528836:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec56d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ab5 expref: 20 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.528863:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec574 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ab5 expref: 19 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.528872:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079b00) 00010000:00010000:3.0:1788813159.528875:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788813159.528878:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164e600, rc 0) 00000100:00100000:3.0:1788813159.528932:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+19:10309:x1875706307965824:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 468us (926us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788813159.528939:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:0.0:1788813159.541265:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813159.541396:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307965952 00000100:00100000:2.0:1788813159.541406:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307965952 00000100:00100000:2.0:1788813159.541466:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:2.0:1788813159.541476:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1207df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+7:2365:x1875706307965952:12345-192.168.203.13@tcp:1:lfs.0 00010000:00010000:2.0:1788813159.541521:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062d3dbca/0x1b294f297b1ec582 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813159.541551:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000061a3daae/0x1b294f297b1ec535 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a99 expref: 7 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813159.541560:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813159.541565:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813159.541570:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062d3dbca/0x1b294f297b1ec582 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813159.541604:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000061a3daae/0x1b294f297b1ec535 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a99 expref: 7 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813159.541617:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000061a3daae/0x1b294f297b1ec535 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a99 expref: 7 pid: 8122 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813159.541650:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36176680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6675:1875706322677760:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788813159.541741:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a1f46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813159.546763:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36176680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6675:1875706322677760:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788813159.546820:0:6675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000062d3dbca/0x1b294f297b1ec582 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813159.553514:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813159.553878:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307966080 00000100:00100000:3.0:1788813159.553887:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307966080 00002000:00100000:3.0:1788813159.553942:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff93ef1207f100 x1875706307966080/t0(0) o4->9c560788-da9a-41fd-952d-091d96dace11@192.168.203.13@tcp:730/0 lens 504/0 e 0 to 0 dl 1788813170 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788813159.553953:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93ef1207f100 with x1875706307966080 ext(0->12) 00010000:00010000:3.0:1788813159.553963:0:6681:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000061a3daae/0x1b294f297b1ec535 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a99 expref: 8 pid: 8122 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.553998:0:6681:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000061a3daae/0x1b294f297b1ec535 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a99 expref: 8 pid: 8122 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788813159.554008:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93ef1207f100 00000100:00100000:3.0:1788813159.554045:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:3.0:1788813159.554056:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9c560788-da9a-41fd-952d-091d96dace11+8:2366:x1875706307966080:12345-192.168.203.13@tcp:4:lfs.0 00000001:00100000:2.0:1788813159.603148:0:6700:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9c560788-da9a-41fd-952d-091d96dace11 00000100:00100000:3.0:1788813159.604074:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9c560788-da9a-41fd-952d-091d96dace11+9:2366:x1875706307966080:12345-192.168.203.13@tcp:4:lfs.0 Request processed in 50014us (50563us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788813159.604087:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00002000:00100000:3.0:1788813159.604209:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff93ef1207f100 x1875706307966080/t4294967299(0) o4->9c560788-da9a-41fd-952d-091d96dace11@192.168.203.13@tcp:730/0 lens 504/448 e 0 to 0 dl 1788813170 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788813159.604221:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93ef1207f100 with x1875706307966080 ext(0->12) 00010000:00010000:3.0:1788813159.604232:0:6681:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000061a3daae/0x1b294f297b1ec535 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a99 expref: 9 pid: 8122 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.604251:0:6681:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000061a3daae/0x1b294f297b1ec535 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a99 expref: 9 pid: 8122 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788813159.604259:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93ef1207f100 00000100:00100000:1.0:1788813159.608410:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813159.608640:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307966208 00000100:00100000:0.0:1788813159.608650:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307966208 00010000:00010000:0.0:1788813159.608689:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000061a3daae/0x1b294f297b1ec535 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a99 expref: 9 pid: 8122 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813159.608733:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:0.0:1788813159.608743:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36160380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+9:2366:x1875706307966208:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813159.608758:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788813159.608775:0:5819:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788813159.608778:0:5819:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788813159 00002000:00010000:0.0:1788813159.608910:0:5819:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788813159 00002000:00010000:0.0:1788813159.608912:0:5819:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788813159 00010000:00010000:0.0:1788813159.608920:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000061a3daae/0x1b294f297b1ec535 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a99 expref: 9 pid: 8122 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.608934:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000061a3daae/0x1b294f297b1ec535 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a99 expref: 9 pid: 8122 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.608956:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061a3daae/0x1b294f297b1ec535 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a99 expref: 9 pid: 8122 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.608971:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813159.608975:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813159.608981:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000062d3dbca/0x1b294f297b1ec582 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.609103:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062d3dbca/0x1b294f297b1ec582 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.609247:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813159.609303:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36160380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+8:2366:x1875706307966208:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 561us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813159.609311:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00010000:00010000:2.0:1788813159.609731:0:6675:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000062d3dbca/0x1b294f297b1ec582 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813159.609743:0:6675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062d3dbca/0x1b294f297b1ec582 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813159.609769:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062d3dbca/0x1b294f297b1ec582 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813159.609777:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062d3dbca/0x1b294f297b1ec582 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813159.609916:0:6675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062d3dbca/0x1b294f297b1ec582 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813159.609924:0:6675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618000 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:2.0:1788813159.609928:0:6675:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062d3dbca/0x1b294f297b1ec582 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813159.609947:0:6675:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062d3dbca/0x1b294f297b1ec582 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813159.609963:0:6675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062d3dbca/0x1b294f297b1ec582 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813159.609970:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062d3dbca/0x1b294f297b1ec582 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813159.610179:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1207df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+7:2365:x1875706307965952:12345-192.168.203.13@tcp:1:lfs.0 Request processed in 68703us (68921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813159.610188:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:1.0:1788813159.613240:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813159.617845:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307966464 00000100:00100000:2.0:1788813159.617859:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307966464 00000100:00100000:3.0:1788813159.618297:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:3.0:1788813159.618308:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+19:10309:x1875706307966464:12345-192.168.203.13@tcp:35:lfs.0 00000004:00010000:3.0:1788813159.618380:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec574 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ab5 expref: 19 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788813159.618692:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1788813159.618752:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1788813159.619268:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1788813159.619321:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec589 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.619336:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec519 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a8b expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.619344:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec589 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.619379:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec519 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a8b expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.619395:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec519 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a8b expref: 23 pid: 5836 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813159.619408:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36636d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5837:1875706322677888:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788813159.619504:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef113a9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788813159.622770:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813159.622907:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307966592 00000100:00100000:2.0:1788813159.622916:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307966592 00010000:00010000:2.0:1788813159.622952:0:8439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec519 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a8b expref: 24 pid: 5836 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813159.622999:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:2.0:1788813159.623009:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36161f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+24:2366:x1875706307966592:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813159.623022:0:8439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813159.623029:0:8439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec519 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a8b expref: 24 pid: 5836 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813159.623059:0:8439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec519 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a8b expref: 24 pid: 5836 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813159.623080:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079b00) 00010000:00010000:2.0:1788813159.623085:0:8439:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec589 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813159.623095:0:8439:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec589 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813159.623102:0:8439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec589 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813159.623121:0:8439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813159.623168:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36161f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+24:2366:x1875706307966592:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 160us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813159.623175:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00010000:00010000:3.0:1788813159.623594:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec519 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a8b expref: 23 pid: 5836 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813159.623612:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36636d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5837:1875706322677888:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788813159.623634:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec589 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.623656:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec589 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.623663:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec589 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788813159.624032:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788813159.624257:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1788813159.624366:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36636d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1875706322678016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788813159.624414:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813159.624443:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef113a9480 going to sleep for 11 seconds 00000100:00100000:2.0:1788813159.624637:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322678016 00000100:00100000:2.0:1788813159.624643:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322678016 00000100:00100000:2.0:1788813159.624702:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788813159.624710:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1875706322678016:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788813159.624816:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1875706322678016:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 106us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813159.624823:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788813159.624861:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36636d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1875706322678016:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788813159.625473:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788813159.625534:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36176680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1875706322678144:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788813159.625598:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813159.625640:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322678144 00000100:00100000:2.0:1788813159.625646:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322678144 00000100:00100000:2.0:1788813159.625673:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813159.625680:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1875706322678144:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788813159.625832:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5837:x1875706322678144:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 151us (232us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788813159.625839:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788813159.626180:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813159.629009:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a1f4300 going to sleep for 11 seconds 00000100:00100000:3.0:1788813159.629059:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36176680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1875706322678144:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788813159.629144:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1788813159.629205:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec589 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.629214:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec589 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.629222:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec589 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.629227:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813159.629232:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec589 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.629239:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec589 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.629268:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079b00) 00010000:00010000:3.0:1788813159.629271:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788813159.629276:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec589 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.629282:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec589 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788813159.629472:0:5837:0:(mdd_object.c:4199:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788813159.629709:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788813159.629722:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 320015939340ns, next at 321015937012ns, rc = 0 00000001:00080000:3.0:1788813159.629729:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1788813159.629779:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079b00) 00010000:00010000:3.0:1788813159.629820:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788813159.629827:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec574 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ab5 expref: 27 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813159.629933:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+26:10309:x1875706307966464:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 11625us (16701us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788813159.629942:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000020:00080000:3.0:1788813159.629947:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788813159.633857:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813159.634008:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307966720 00000100:00100000:0.0:1788813159.634018:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307966720 00000100:00100000:0.0:1788813159.634074:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:0.0:1788813159.634084:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+26:10309:x1875706307966720:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813159.634103:0:8565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813159.634124:0:8565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce400/0x1b294f297b1ec590 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2abc expref: -99 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.634176:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce400/0x1b294f297b1ec590 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2abc expref: 27 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.634189:0:8565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce400/0x1b294f297b1ec590 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2abc expref: 27 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813159.634204:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079c00) 00010000:00010000:0.0:1788813159.634207:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788813159.634211:0:8565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190ce400, rc 0) 00000100:00100000:0.0:1788813159.634267:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+27:10309:x1875706307966720:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 185us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813159.634273:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:0.0:1788813159.648042:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813159.648140:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307966976 00000100:00100000:1.0:1788813159.648149:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307966976 00000100:00100000:1.0:1788813159.648200:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:1.0:1788813159.648209:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef0e7fa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+27:10309:x1875706307966976:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1788813159.648429:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef0e7fa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+28:10309:x1875706307966976:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 220us (395us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1788813159.648436:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:2.0:1788813159.719690:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813159.719833:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307967232 00000100:00100000:3.0:1788813159.719844:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307967232 00000100:00100000:3.0:1788813159.719905:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:3.0:1788813159.719916:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+28:10319:x1875706307967232:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813159.719939:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813159.719959:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec597 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2ac3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813159.720064:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788813159.720170:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec597 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ac3 expref: 30 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.720181:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef1a079900) 00010000:00010000:3.0:1788813159.720184:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813159.720190:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec597 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ac3 expref: 30 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.720203:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164e600, rc 0) 00000100:00100000:3.0:1788813159.720350:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+29:10319:x1875706307967232:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 436us (670us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1788813159.720355:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:2.0:1788813159.724754:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813159.724859:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307967360 00000100:00100000:3.0:1788813159.724868:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307967360 00000100:00100000:3.0:1788813159.724917:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:3.0:1788813159.724924:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+29:10319:x1875706307967360:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:3.0:1788813159.724991:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec5a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725007:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec5a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725017:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec5a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725032:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec5ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725053:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec5ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725061:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec5ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725147:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec5b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725155:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec5b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725163:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec5b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813159.725205:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec5b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725218:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec5a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725225:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec5a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725232:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec5a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725239:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813159.725243:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec5a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725252:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec5a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725270:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:3.0:1788813159.725272:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813159.725277:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec5a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725283:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec5a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725295:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec5ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725300:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec5ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725305:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec5ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725310:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813159.725312:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec5ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725318:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec5ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725324:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ef077b4700) 00010000:00010000:3.0:1788813159.725326:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813159.725329:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec5ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725335:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec5ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725360:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec5b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725367:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec5b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725373:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec5b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725378:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813159.725381:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec5b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725387:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec5b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725393:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079c00) 00010000:00010000:3.0:1788813159.725396:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813159.725398:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec5b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.725404:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec5b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813159.725478:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+29:10319:x1875706307967360:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 553us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813159.725486:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:0.0:1788813159.728255:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813159.728375:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307967616 00000100:00100000:1.0:1788813159.728384:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307967616 00000100:00100000:1.0:1788813159.728435:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:1.0:1788813159.728445:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1207dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+29:10319:x1875706307967616:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1788813159.728675:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1207dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+30:10319:x1875706307967616:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 231us (427us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788813159.728682:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:3.0:1788813159.803592:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813159.803714:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307967872 00000100:00100000:1.0:1788813159.803724:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307967872 00000100:00100000:1.0:1788813159.803823:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:1.0:1788813159.803834:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+30:10322:x1875706307967872:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813159.803868:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813159.803902:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ec5ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2aca expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.803972:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ec5c1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.803986:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ec5c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.803997:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ec5c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.804011:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ec5c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.804017:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ec5c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.804023:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ec5c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.804135:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ec5cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.804144:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ec5cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.804151:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ec5cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813159.804161:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788813159.804258:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ec5c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.804266:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ec5c1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.804271:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ec5c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.804277:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fc200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813159.804281:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ec5c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.804289:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ec5c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.804300:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:1.0:1788813159.804303:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813159.804318:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ec5c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.804324:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ec5c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.804337:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ec5c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.804343:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ec5c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.804349:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ec5c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.804364:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fcc00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813159.804366:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ec5c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.804373:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ec5c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.804381:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ef19f1fd00) 00010000:00010000:1.0:1788813159.804384:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813159.804387:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ec5c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.804393:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ec5c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.804436:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ec5ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2aca expref: 33 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.804450:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ec5cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2aca expref: 32 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813159.804457:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079c00) 00010000:00010000:1.0:1788813159.804459:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813159.804462:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fc400, rc 0) 00000100:00100000:1.0:1788813159.804512:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+32:10322:x1875706307967872:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 681us (930us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788813159.804520:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:2.0:1788813159.809751:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813159.809879:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307968000 00000100:00100000:3.0:1788813159.809889:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307968000 00000100:00100000:3.0:1788813159.809969:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:3.0:1788813159.809979:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+32:10322:x1875706307968000:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:3.0:1788813159.810040:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec5dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.810056:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec5dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.810068:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec5dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.810093:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec5dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.810100:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec5dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.810108:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec5dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.810113:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813159.810118:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec5dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.810124:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec5dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.810135:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079c00) 00010000:00010000:3.0:1788813159.810138:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813159.810142:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec5dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813159.810160:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec5dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813159.810226:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+32:10322:x1875706307968000:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 247us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813159.810234:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:0.0:1788813159.820111:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813159.820244:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307968256 00000100:00100000:1.0:1788813159.820265:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307968256 00000100:00100000:1.0:1788813159.820333:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:1.0:1788813159.820344:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1207d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+32:10322:x1875706307968256:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1788813159.820773:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1207d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+33:10322:x1875706307968256:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 430us (671us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788813159.820829:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:0.0:1788813160.125181:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813160.125277:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307968512 00000100:00100000:2.0:1788813160.125288:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307968512 00000100:00100000:2.0:1788813160.125368:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:2.0:1788813160.125379:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1207ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+33:10353:x1875706307968512:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:2.0:1788813160.125415:0:8565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813160.125436:0:8565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ec5e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2ad1 expref: -99 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813160.125550:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ec5eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813160.125564:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ec5eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813160.125574:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ec5eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813160.125602:0:8565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788813160.125722:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ec5e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ad1 expref: 36 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813160.125741:0:8565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ec5eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ad1 expref: 35 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813160.125749:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079c00) 00010000:00010000:2.0:1788813160.125752:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813160.125755:0:8565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21618800, rc 0) 00000100:00100000:2.0:1788813160.125855:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1207ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+35:10353:x1875706307968512:12345-192.168.203.13@tcp:101:cat.0 Request processed in 478us (684us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788813160.125862:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00080000:1.0:1788813160.126296:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813160.152389:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813160.152443:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813160.153890:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307968768 00000100:00100000:3.0:1788813160.153903:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307968768 00000100:00100000:3.0:1788813160.153991:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:3.0:1788813160.154002:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+35:10353:x1875706307968768:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:3.0:1788813160.154261:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+36:10353:x1875706307968768:12345-192.168.203.13@tcp:35:cat.0 Request processed in 260us (1881us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788813160.154269:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:0.0:1788813160.155309:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307968896 00000100:00100000:0.0:1788813160.155320:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307968896 00000100:00100000:0.0:1788813160.155387:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:0.0:1788813160.155397:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef121e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+36:2365:x1875706307968896:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813160.155409:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813160.155431:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ec5eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ad1 expref: 36 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813160.155450:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079c00) 00010000:00010000:0.0:1788813160.155456:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813160.155499:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef121e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+35:2365:x1875706307968896:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 104us (3055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813160.155507:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:1.0:1788813160.224673:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813160.224754:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307969152 00000100:00100000:3.0:1788813160.224765:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307969152 00000100:00100000:3.0:1788813160.224845:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:3.0:1788813160.224856:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+35:10359:x1875706307969152:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:3.0:1788813160.224879:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813160.224883:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788813160.224909:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec551 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2aa7 expref: 35 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.224928:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:3.0:1788813160.224934:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813160.224948:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec5f9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2ad8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.225076:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec600 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.225091:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ec5cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2aca expref: 35 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.225099:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec600 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.225133:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ec5cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2aca expref: 35 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.225146:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ec5cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2aca expref: 35 pid: 5836 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813160.225159:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36635f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875706322678272:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788813160.225252:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef113a9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813160.230776:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36635f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875706322678272:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788813160.230824:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec600 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813160.235518:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813160.235599:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307969280 00000100:00100000:2.0:1788813160.235620:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307969280 00010000:00010000:2.0:1788813160.235662:0:8439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ec5cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2aca expref: 36 pid: 5836 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813160.235705:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:2.0:1788813160.235715:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36163b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+36:2366:x1875706307969280:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813160.235729:0:8439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813160.235735:0:8439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ec5cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2aca expref: 36 pid: 5836 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813160.235767:0:8439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ec5cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2aca expref: 36 pid: 5836 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813160.235809:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ec5cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2aca expref: 36 pid: 5836 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813160.235825:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079c00) 00010000:00010000:2.0:1788813160.235830:0:8439:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec600 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813160.235840:0:8439:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec600 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813160.235847:0:8439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec600 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813160.235880:0:8439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813160.235936:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36163b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+35:2366:x1875706307969280:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 222us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813160.235943:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00010000:00010000:0.0:1788813160.236078:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec600 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813160.236088:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec600 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813160.236107:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788813160.236522:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec5f9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ad8 expref: 36 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813160.236551:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec600 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ad8 expref: 35 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813160.236571:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079c00) 00010000:00010000:0.0:1788813160.236574:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788813160.236577:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164e000, rc 0) 00000100:00100000:0.0:1788813160.236609:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+35:10359:x1875706307969152:12345-192.168.203.13@tcp:101:dd.0 Request processed in 11755us (11945us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788813160.236616:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:0.0:1788813160.241901:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813160.242127:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307969536 00000100:00100000:3.0:1788813160.242137:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307969536 00000100:00100000:3.0:1788813160.242195:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:3.0:1788813160.242205:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1207f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+35:10359:x1875706307969536:12345-192.168.203.13@tcp:36:dd.0 00010000:00010000:3.0:1788813160.242465:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec60e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.242497:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec60e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.242510:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec60e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788813160.242576:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1788813160.242600:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2dcd4c6 reply state 00000000acd04987 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec60e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813160.242609:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788813160.242709:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1207f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+38:10359:x1875706307969536:12345-192.168.203.13@tcp:36:dd.0 Request processed in 504us (815us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788813160.242715:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00000020:00080000:3.0:1788813160.242720:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788813160.244746:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec60e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.244760:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec60e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.244767:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec60e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.244772:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813160.244777:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec60e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.244811:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec60e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.244846:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079c00) 00010000:00010000:3.0:1788813160.244849:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813160.244855:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec60e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.244862:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec60e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813160.412988:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813160.625290:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813160.625747:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307969664 00000100:00100000:3.0:1788813160.625758:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307969664 00000100:00100000:3.0:1788813160.625866:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:3.0:1788813160.625878:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1207ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+37:10373:x1875706307969664:12345-192.168.203.13@tcp:101:stat.0 00010000:00010000:3.0:1788813160.626114:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813160.626138:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec615 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2adf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.626206:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec61c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.626220:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec61c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.626233:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec61c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.626249:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec623 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.626256:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec623 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.626281:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec623 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.626361:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec62a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.626373:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec600 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ad8 expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.626381:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec62a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.626415:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec600 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ad8 expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.626428:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec600 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ad8 expref: 38 pid: 5835 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813160.626441:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36635f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875706322678400:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788813160.626551:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef113a9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788813160.640267:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36635f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875706322678400:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788813160.640303:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec62a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813160.645758:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813160.645831:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307969920 00000100:00100000:1.0:1788813160.645841:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307969920 00000100:00100000:1.0:1788813160.645899:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:1.0:1788813160.645915:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1207fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+39:5598:x1875706307969920:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788813160.646266:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1207fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+40:5598:x1875706307969920:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 353us (516us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1788813160.646273:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:2.0:1788813160.661813:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813160.661932:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307970048 00000100:00100000:1.0:1788813160.661941:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307970048 00010000:00010000:1.0:1788813160.661983:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec600 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ad8 expref: 40 pid: 5835 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813160.662021:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:1.0:1788813160.662031:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36176300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+40:2363:x1875706307970048:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813160.662045:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813160.662051:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec600 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ad8 expref: 40 pid: 5835 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813160.662081:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec600 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ad8 expref: 40 pid: 5835 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813160.662109:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec600 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ad8 expref: 40 pid: 5835 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813160.662126:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079c00) 00010000:00010000:1.0:1788813160.662131:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec62a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813160.662140:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec62a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813160.662148:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec62a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813160.662179:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813160.662227:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec62a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.662237:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec62a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813160.662237:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36176300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+39:2363:x1875706307970048:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 207us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813160.662245:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000004:00200000:3.0:1788813160.662288:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788813160.662292:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813160.662341:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec62a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.662353:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec62a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.662361:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec61c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.662367:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec61c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.662373:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec61c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.662379:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813160.662383:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec61c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.662390:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec61c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.662399:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:3.0:1788813160.662402:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813160.662406:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec61c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.662412:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec61c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.662433:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec623 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.662438:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec623 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.662444:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec623 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.662449:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813160.662451:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec623 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.662457:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec623 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.662464:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ef077b4700) 00010000:00010000:3.0:1788813160.662466:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813160.662469:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec623 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.662474:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec623 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.662506:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec615 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2adf expref: 39 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.662519:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec62a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2adf expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.662549:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079c00) 00010000:00010000:3.0:1788813160.662552:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813160.662554:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164ee00, rc 0) 00000100:00100000:3.0:1788813160.662601:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1207ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+38:10373:x1875706307969664:12345-192.168.203.13@tcp:101:stat.0 Request processed in 36725us (37320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813160.662608:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:2.0:1788813160.794948:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813160.795145:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307970304 00000100:00100000:0.0:1788813160.795156:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307970304 00000100:00100000:0.0:1788813160.795216:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:0.0:1788813160.795227:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+38:10379:x1875706307970304:12345-192.168.203.13@tcp:36:truncate.0 00010000:00010000:0.0:1788813160.795278:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813160.795302:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec62a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2adf expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813160.795321:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079c00) 00010000:00010000:0.0:1788813160.795326:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813160.795544:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec631 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813160.795558:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec631 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813160.795568:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec631 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788813160.795631:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1788813160.795656:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002673ece2 reply state 0000000020f7efa5 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec631 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813160.795664:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788813160.795774:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+40:10379:x1875706307970304:12345-192.168.203.13@tcp:36:truncate.0 Request processed in 542us (827us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788813160.795834:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00000020:00080000:0.0:1788813160.795839:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788813160.798314:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec631 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.798331:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec631 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.798339:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec631 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.798345:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cf400 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813160.798350:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec631 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.798358:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec631 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.798373:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079c00) 00010000:00010000:3.0:1788813160.798376:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813160.798381:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec631 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813160.798387:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec631 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813161.045904:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813161.046009:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307970432 00000100:00100000:0.0:1788813161.046019:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307970432 00000100:00100000:0.0:1788813161.046079:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:0.0:1788813161.046090:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+39:10393:x1875706307970432:12345-192.168.203.13@tcp:101:stat.0 00010000:00010000:0.0:1788813161.046113:0:8565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813161.046134:0:8565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ec638 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2ae6 expref: -99 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046196:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ec63f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046209:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ec63f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046219:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ec63f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046234:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec646 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046260:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046267:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046350:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec64d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046358:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec64d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046365:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec64d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813161.046398:0:8565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788813161.046402:0:8565:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788813161.046428:0:8565:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec64d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046439:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec64d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046447:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ec63f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046453:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ec63f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046459:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ec63f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046474:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cfa00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813161.046479:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ec63f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046486:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ec63f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046499:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:0.0:1788813161.046502:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813161.046507:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ec63f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046513:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ec63f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046540:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046547:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec646 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046553:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046558:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cfe00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813161.046561:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046567:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec646 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046585:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ef1a079e00) 00010000:00010000:0.0:1788813161.046588:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813161.046591:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec646 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046597:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec646 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046638:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ec638 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ae6 expref: 41 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046651:0:8565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec64d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ae6 expref: 40 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.046658:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079c00) 00010000:00010000:0.0:1788813161.046660:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813161.046663:0:8565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cfc00, rc 0) 00000100:00100000:0.0:1788813161.046725:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+40:10393:x1875706307970432:12345-192.168.203.13@tcp:101:stat.0 Request processed in 637us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813161.046733:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:1.0:1788813161.117119:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322678528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813161.117187:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813161.117453:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875706322678784:0@lo:400:kworker.0 00000100:00100000:1.0:1788813161.117482:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813161.117501:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788813161.117507:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36161880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322678656:0@lo:400:kworker.0 00000100:00100000:1.0:1788813161.117545:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813161.117584:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36161500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1875706322679168:0@lo:400:kworker.0 00000100:00100000:1.0:1788813161.117606:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813161.117632:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322678656 00000100:00100000:1.0:1788813161.117639:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322678656 00000100:00100000:1.0:1788813161.117676:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788813161.117684:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3302:x1875706322678656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813161.117728:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3302:x1875706322678656:12345-0@lo:400:kworker.0 Request processed in 45us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813161.117735:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788813161.117764:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322679040:0@lo:400:kworker.0 00000100:00100000:1.0:1788813161.117811:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813161.117830:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813161.117835:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1875706322678912:0@lo:400:kworker.0 00000100:00100000:1.0:1788813161.117857:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813161.117878:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322679040 00000100:00100000:1.0:1788813161.117882:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322679040 00000100:00100000:1.0:1788813161.117914:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788813161.117920:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1875706322679040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813161.117953:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1875706322679040:12345-0@lo:400:kworker.0 Request processed in 33us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813161.117959:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1788813161.117985:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813161.118008:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36161880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322678656:0@lo:400:kworker.0 00000100:00100000:1.0:1788813161.118037:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322679040:0@lo:400:kworker.0 00000100:00100000:3.0:1788813161.118172:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322678784 00000100:00100000:3.0:1788813161.118177:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322678784 00000100:00100000:3.0:1788813161.118212:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322679168 00000100:00100000:3.0:1788813161.118215:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322679168 00000100:00100000:3.0:1788813161.118237:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322678912 00000100:00100000:3.0:1788813161.118240:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322678912 00000100:00100000:3.0:1788813161.118254:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788813161.118260:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875706322678784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813161.118299:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875706322678784:12345-0@lo:400:kworker.0 Request processed in 39us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813161.118305:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788813161.118325:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788813161.118331:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875706322679168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813161.118356:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875706322679168:12345-0@lo:400:kworker.0 Request processed in 26us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813161.118361:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788813161.118372:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788813161.118377:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875706322678912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813161.118403:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875706322678912:12345-0@lo:400:kworker.0 Request processed in 26us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813161.118408:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1788813161.118421:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813161.118437:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36161500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1875706322679168:0@lo:400:kworker.0 00000100:00100000:3.0:1788813161.118447:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875706322678784:0@lo:400:kworker.0 00000004:00080000:3.0:1788813161.118658:0:6776:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 321504875805ns, next at 322504873600ns, rc = 0 00000100:00100000:3.0:1788813161.118681:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813161.118690:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322679296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813161.118719:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813161.118748:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322678528 00000100:00100000:3.0:1788813161.118752:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322678528 00000100:00100000:3.0:1788813161.118800:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322679296 00000100:00100000:3.0:1788813161.118803:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322679296 00000100:00100000:3.0:1788813161.118817:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788813161.118823:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322678528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813161.118847:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813161.118879:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322678528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (1692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813161.118885:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788813161.118897:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788813161.118904:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875706322679296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813161.118920:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813161.118950:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875706322679296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813161.118956:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788813161.119001:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322679296:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788813161.119017:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813161.119256:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1875706322678912:0@lo:400:kworker.0 00000100:00100000:1.0:1788813161.119283:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322678528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813161.146949:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813161.147809:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307970688 00000100:00100000:3.0:1788813161.147823:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307970688 00000100:00100000:3.0:1788813161.147919:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:3.0:1788813161.147931:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1207ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+40:10403:x1875706307970688:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813161.147958:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813161.148177:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec654 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2aed expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813161.148304:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788813161.148450:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec654 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2aed expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.148466:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef1a079900) 00010000:00010000:3.0:1788813161.148470:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813161.148476:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec654 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2aed expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.148495:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164f000, rc 0) 00000100:00100000:3.0:1788813161.148628:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1207ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+41:10403:x1875706307970688:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 699us (1705us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1788813161.148636:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:1.0:1788813161.168752:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813161.168899:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307970944 00000100:00100000:3.0:1788813161.168912:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307970944 00000100:00100000:3.0:1788813161.168999:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:3.0:1788813161.169209:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+41:10403:x1875706307970944:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1788813161.169576:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+42:10403:x1875706307970944:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 566us (836us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1788813161.169584:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:2.0:1788813161.235673:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813161.235925:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307971200 00000100:00100000:3.0:1788813161.235938:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307971200 00000100:00100000:3.0:1788813161.236136:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:3.0:1788813161.236148:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+42:10409:x1875706307971200:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1788813161.236189:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813161.236216:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec662 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2af4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.236350:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec669 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.236368:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec64d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ae6 expref: 43 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.236378:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec669 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.236420:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec64d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ae6 expref: 43 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.236435:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec64d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ae6 expref: 43 pid: 8565 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813161.236451:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36635f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875706322679424:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788813161.236569:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef113a9480 going to sleep for 11 seconds 00000100:00100000:1.0:1788813161.240809:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813161.240933:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307971328 00000100:00100000:2.0:1788813161.240946:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307971328 00010000:00010000:2.0:1788813161.241007:0:8439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec64d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ae6 expref: 44 pid: 8565 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813161.241072:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:2.0:1788813161.241082:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36161c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+44:2365:x1875706307971328:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813161.241099:0:8439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813161.241106:0:8439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec64d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ae6 expref: 44 pid: 8565 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813161.241122:0:8439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec64d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ae6 expref: 44 pid: 8565 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813161.241148:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079c00) 00010000:00010000:2.0:1788813161.241154:0:8439:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec669 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813161.241166:0:8439:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec669 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813161.241176:0:8439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec669 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813161.241197:0:8439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813161.241260:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36161c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+44:2365:x1875706307971328:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 179us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813161.241267:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00010000:00010000:3.0:1788813161.243454:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec64d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ae6 expref: 43 pid: 8565 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813161.243488:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36635f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875706322679424:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788813161.243523:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec669 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.243570:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec669 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.243577:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec669 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813161.243604:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1788813161.245565:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec662 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2af4 expref: 44 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.245605:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec669 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2af4 expref: 43 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.245616:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079c00) 00010000:00010000:3.0:1788813161.245619:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788813161.245623:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164f800, rc 0) 00000100:00100000:3.0:1788813161.245717:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+43:10409:x1875706307971200:12345-192.168.203.13@tcp:101:bash.0 Request processed in 9570us (10058us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1788813161.245729:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:1.0:1788813161.258843:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813161.260009:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307971584 00000100:00100000:0.0:1788813161.260026:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307971584 00000100:00100000:0.0:1788813161.260238:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:0.0:1788813161.260253:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+43:10409:x1875706307971584:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:0.0:1788813161.260611:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec677 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.260658:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec677 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.260673:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec677 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788813161.260736:0:8565:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1788813161.260765:0:8565:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d6f2068 reply state 00000000544a98ce transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec677 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813161.260775:0:8565:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788813161.261520:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+46:10409:x1875706307971584:12345-192.168.203.13@tcp:36:bash.0 Request processed in 1265us (2736us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788813161.261544:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00000020:00080000:0.0:1788813161.261550:0:8565:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788813161.266357:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec677 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.266380:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec677 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.266388:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec677 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.266394:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cfe00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813161.266423:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec677 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.266433:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec677 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.266453:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079c00) 00010000:00010000:3.0:1788813161.266457:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813161.266462:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec677 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.266469:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec677 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813161.276033:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813161.276188:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307971712 00000100:00100000:3.0:1788813161.276203:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307971712 00000100:00100000:3.0:1788813161.276277:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:3.0:1788813161.276291:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+45:10409:x1875706307971712:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1788813161.276321:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813161.276348:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec67e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2afb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.276485:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec685 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.276504:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec669 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2af4 expref: 46 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.276513:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec685 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.276576:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec669 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2af4 expref: 46 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.276591:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec669 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2af4 expref: 46 pid: 5836 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813161.276607:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36635f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1875706322679552:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788813161.276719:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef113a9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813161.288876:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36635f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1875706322679552:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788813161.288919:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec685 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813161.290374:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813161.290992:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307971840 00000100:00100000:3.0:1788813161.291003:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307971840 00010000:00010000:3.0:1788813161.291057:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec669 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2af4 expref: 47 pid: 5836 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813161.291106:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:3.0:1788813161.291118:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36161880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+47:2366:x1875706307971840:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813161.291144:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813161.291151:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec669 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2af4 expref: 47 pid: 5836 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.291166:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec669 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2af4 expref: 47 pid: 5836 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.291217:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec669 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2af4 expref: 47 pid: 5836 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.291238:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079c00) 00010000:00010000:3.0:1788813161.291244:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec685 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.291255:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.291263:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec685 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.291593:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813161.291675:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36161880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+46:2366:x1875706307971840:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 559us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813161.291685:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00010000:00010000:0.0:1788813161.299485:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.299509:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813161.299599:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788813161.299605:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788813161.299635:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.299690:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec67e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2afb expref: 46 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.299719:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec685 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2afb expref: 45 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.299753:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079c00) 00010000:00010000:0.0:1788813161.299757:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813161.299760:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164e600, rc 0) 00000100:00100000:0.0:1788813161.301596:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+45:10409:x1875706307971712:12345-192.168.203.13@tcp:101:bash.0 Request processed in 25295us (25565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813161.301612:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:1.0:1788813161.314161:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813161.314375:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307972096 00000100:00100000:3.0:1788813161.314388:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307972096 00000100:00100000:3.0:1788813161.314462:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:3.0:1788813161.314475:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef0e7f8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+45:10409:x1875706307972096:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:3.0:1788813161.314840:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef0e7f8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+46:10409:x1875706307972096:12345-192.168.203.13@tcp:35:bash.0 Request processed in 368us (692us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1788813161.314849:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:1.0:1788813161.413313:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813161.417109:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307972352 00000100:00100000:3.0:1788813161.417131:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307972352 00000100:00100000:3.0:1788813161.417246:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:3.0:1788813161.417276:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+46:10419:x1875706307972352:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813161.417309:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813161.417336:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec68c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2b02 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813161.417454:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788813161.417667:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec68c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b02 expref: 48 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.417684:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef1a079900) 00010000:00010000:3.0:1788813161.417687:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813161.417694:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec68c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b02 expref: 48 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.417712:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164f800, rc 0) 00000100:00100000:3.0:1788813161.417865:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+47:10419:x1875706307972352:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 591us (4566us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1788813161.417874:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:2.0:1788813161.420910:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813161.422872:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307972480 00000100:00100000:3.0:1788813161.422892:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307972480 00000100:00100000:3.0:1788813161.422998:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:3.0:1788813161.423010:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+47:10419:x1875706307972480:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:3.0:1788813161.423116:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec69a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423135:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec69a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423173:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec69a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423191:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec6a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423199:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423206:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423314:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec6a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423323:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423330:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813161.423395:0:7630:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423410:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec69a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423417:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec69a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423425:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec69a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423441:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813161.423447:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec69a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423454:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec69a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423468:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:3.0:1788813161.423471:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813161.423477:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec69a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423483:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec69a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423500:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423505:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec6a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423510:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec6a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423514:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164ee00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813161.423516:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec6a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423522:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec6a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423550:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ef077b4700) 00010000:00010000:3.0:1788813161.423552:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813161.423555:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec6a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423561:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec6a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423576:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423580:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec6a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423586:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec6a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423591:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813161.423593:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec6a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423597:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec6a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423603:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079c00) 00010000:00010000:3.0:1788813161.423605:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813161.423608:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec6a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.423614:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec6a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813161.423727:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+47:10419:x1875706307972480:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 718us (2827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813161.423736:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:1.0:1788813161.433465:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813161.433764:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307972736 00000100:00100000:3.0:1788813161.433912:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307972736 00000100:00100000:3.0:1788813161.434485:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:3.0:1788813161.434499:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+47:10419:x1875706307972736:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1788813161.434946:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+48:10419:x1875706307972736:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 449us (1493us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788813161.434954:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00010000:00010000:2.0:1788813161.441229:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813161.480047:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813161.480384:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307972992 00000100:00100000:0.0:1788813161.480399:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307972992 00000100:00100000:0.0:1788813161.480518:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:0.0:1788813161.480540:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+48:10423:x1875706307972992:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813161.480661:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813161.480690:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ec6af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2b09 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.480856:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec6b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.480874:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec6b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.480890:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec6b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.480907:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec6bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.480915:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec6bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.480944:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec6bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.481126:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ec6c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.481135:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ec6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.481142:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ec6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813161.481153:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788813161.481938:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec6b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.481953:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec6b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.481961:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec6b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.482021:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cee00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813161.482027:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec6b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.482037:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec6b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.482052:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:1.0:1788813161.482055:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813161.482061:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec6b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.482239:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec6b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.482259:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec6bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.482265:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec6bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.482271:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec6bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.482276:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190ce200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813161.482279:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec6bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.482286:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec6bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.482295:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ef1a079e00) 00010000:00010000:1.0:1788813161.482298:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813161.482301:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec6bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.482307:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec6bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.482518:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ec6af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b09 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.482549:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ec6c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b09 expref: 50 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.482566:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079c00) 00010000:00010000:1.0:1788813161.482569:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813161.482572:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cec00, rc 0) 00000100:00100000:1.0:1788813161.482674:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+50:10423:x1875706307972992:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 2136us (2641us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1788813161.482685:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:2.0:1788813161.486678:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813161.486753:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813161.487952:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307973120 00000100:00100000:3.0:1788813161.487978:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307973120 00000100:00100000:3.0:1788813161.488069:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:3.0:1788813161.488082:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36177480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+50:2364:x1875706307973120:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813161.488103:0:8439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813161.488136:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ec6c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b09 expref: 50 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813161.488162:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079c00) 00010000:00010000:3.0:1788813161.488168:0:8439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813161.488239:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36177480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+49:2364:x1875706307973120:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 160us (1576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813161.488246:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:0.0:1788813161.490073:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307973248 00000100:00100000:0.0:1788813161.490162:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307973248 00000100:00100000:0.0:1788813161.490285:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:0.0:1788813161.490297:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3696d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+49:10423:x1875706307973248:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:0.0:1788813161.490386:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec6d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.490408:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec6d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.490423:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec6d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.490458:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec6d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.490466:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec6d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.490494:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec6d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.490502:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cf800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813161.490507:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec6d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.490517:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec6d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.490543:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079c00) 00010000:00010000:0.0:1788813161.490547:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788813161.490553:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec6d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.490561:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec6d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813161.490655:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3696d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+49:10423:x1875706307973248:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 360us (3900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813161.490664:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:2.0:1788813161.500337:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813161.500463:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307973504 00000100:00100000:0.0:1788813161.500477:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307973504 00000100:00100000:0.0:1788813161.500560:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:0.0:1788813161.500572:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3645b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+49:10423:x1875706307973504:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1788813161.500930:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3645b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+50:10423:x1875706307973504:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 358us (606us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788813161.500938:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:2.0:1788813161.643719:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813161.643904:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307973760 00000100:00100000:1.0:1788813161.643917:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307973760 00000100:00100000:1.0:1788813161.644169:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:1.0:1788813161.644183:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3645ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+50:10441:x1875706307973760:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:1.0:1788813161.644216:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813161.644243:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ec6d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2b10 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.644371:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ec6e0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.644389:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ec6e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.644406:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ec6e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813161.644419:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788813161.644592:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ec6d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b10 expref: 53 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.644768:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ec6e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b10 expref: 52 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.644778:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079c00) 00010000:00010000:1.0:1788813161.644849:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788813161.644854:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fc000, rc 0) 00000100:00100000:1.0:1788813161.645151:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3645ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+52:10441:x1875706307973760:12345-192.168.203.13@tcp:101:cat.0 Request processed in 969us (1442us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1788813161.645161:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:2.0:1788813161.670003:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813161.670231:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307973888 00000100:00100000:1.0:1788813161.670244:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307973888 00000100:00100000:1.0:1788813161.670318:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:1.0:1788813161.670330:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+52:10442:x1875706307973888:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813161.670362:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813161.670388:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ec6ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2b17 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.670473:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ec6f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.670491:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ec6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.670506:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ec6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813161.670563:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788813161.670584:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813161.670726:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ec6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.670763:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ec6ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b17 expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.670946:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ec6f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b17 expref: 53 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.670956:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:1.0:1788813161.670959:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813161.670963:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fd000, rc 0) 00000100:00100000:1.0:1788813161.671051:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+53:10442:x1875706307973888:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 724us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813161.671059:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:3.0:1788813161.681702:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813161.681815:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307974272 00000100:00100000:0.0:1788813161.681828:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307974272 00000100:00100000:0.0:1788813161.681898:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:0.0:1788813161.681908:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+53:10442:x1875706307974272:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1788813161.682631:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+54:10442:x1875706307974272:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 721us (937us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1788813161.682640:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:3.0:1788813161.685885:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813161.686454:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307974400 00000100:00100000:0.0:1788813161.686469:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307974400 00000100:00100000:0.0:1788813161.686564:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:0.0:1788813161.686575:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+54:10442:x1875706307974400:12345-192.168.203.13@tcp:103:lfs.0 00010000:00010000:0.0:1788813161.686611:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788813161.686645:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec685 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2afb expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.686672:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ec6e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b10 expref: 53 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.686686:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce400/0x1b294f297b1ec590 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2abc expref: 52 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.686698:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079c00) 00010000:00010000:0.0:1788813161.686710:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813161.686834:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+51:10442:x1875706307974400:12345-192.168.203.13@tcp:103:lfs.0 Request processed in 208us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813161.686842:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:2.0:1788813161.691351:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813161.691447:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307974528 00000100:00100000:0.0:1788813161.691478:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307974528 00000100:00100000:0.0:1788813161.691566:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:0.0:1788813161.691580:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3645a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+51:10442:x1875706307974528:12345-192.168.203.13@tcp:58:lfs.0 00010000:00010000:0.0:1788813161.691767:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec6fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.691819:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec6fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813161.691833:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec6fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788813161.692235:0:8565:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813161.692451:0:8565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788813161.692533:0:8565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788813161.692678:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3645a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+51:10442:x1875706307974528:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 1099us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813161.692689:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:2.0:1788813161.719936:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813161.720627:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307974656 00000100:00100000:1.0:1788813161.720642:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307974656 00000100:00100000:1.0:1788813161.720830:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:1.0:1788813161.720844:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36459f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+51:10444:x1875706307974656:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813161.720874:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813161.720903:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ec703 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2b1e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.721013:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ec70a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.721032:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ec70a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.721073:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ec70a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.721214:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ec711 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.721222:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ec711 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.721230:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ec711 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.721342:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ec718 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.721352:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ec718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.721359:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ec718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813161.721406:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788813161.721411:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813161.721434:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ec718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.721447:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ec718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.721456:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ec70a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.721474:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ec70a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.721481:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ec70a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.721488:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fde00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813161.721494:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ec70a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.721503:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ec70a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.721518:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:1.0:1788813161.721521:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813161.721538:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ec70a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.721545:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ec70a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.721562:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ec711 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.721568:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ec711 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.721575:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ec711 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.721581:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fce00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813161.721590:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ec711 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.721598:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ec711 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.721918:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ef19f1fd00) 00010000:00010000:1.0:1788813161.721921:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813161.721937:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ec711 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.721944:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ec711 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.721988:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ec703 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b1e expref: 53 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.722001:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ec718 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b1e expref: 52 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813161.722008:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079d00) 00010000:00010000:1.0:1788813161.722011:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813161.722014:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fd200, rc 0) 00000100:00100000:1.0:1788813161.722376:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36459f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+52:10444:x1875706307974656:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1533us (2459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813161.722385:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 67 00000040:00080000:3.0:1788813162.143897:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788813162.143911:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788813162.143989:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788813162.143997:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788813162.144160:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36635880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1875706322679680:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788813162.144275:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef113a9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788813162.156854:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36635880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1875706322679680:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788813162.156883:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813162.156944:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307974784 00000100:00100000:0.0:1788813162.156955:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307974784 00000100:00100000:0.0:1788813162.157044:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:0.0:1788813162.157058:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1207dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9c560788-da9a-41fd-952d-091d96dace11+52:10455:x1875706307974784:12345-192.168.203.13@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788813162.157162:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1207dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9c560788-da9a-41fd-952d-091d96dace11+52:10455:x1875706307974784:12345-192.168.203.13@tcp:900:lhsmtool_posix.0 Request processed in 108us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813162.157170:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00080000:0.0:1788813162.157198:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813162.161900:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813162.162019:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307974912 00000100:00100000:1.0:1788813162.162036:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307974912 00000100:00100000:1.0:1788813162.162111:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:1.0:1788813162.162123:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3645bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+52:10455:x1875706307974912:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788813162.162182:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788813162.172194:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3645bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+52:10455:x1875706307974912:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 10060us (10298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813162.172211:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:0.0:1788813162.190990:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813162.191207:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307975040 00000100:00100000:2.0:1788813162.191221:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307975040 00000100:00100000:2.0:1788813162.191304:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:2.0:1788813162.191316:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1207d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+52:10455:x1875706307975040:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788813162.191418:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec71f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.191440:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec71f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.191454:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec71f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.193772:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ec726 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.193808:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ec726 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.193821:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ec726 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.193857:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec72d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.193880:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec72d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.193888:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec72d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813162.193932:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788813162.193937:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788813162.193954:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec72d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.193967:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec71f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.193973:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec71f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.193980:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec71f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.193987:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618400 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813162.193991:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec71f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.193998:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec71f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.194010:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ef077b4200) 00010000:00010000:2.0:1788813162.194013:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813162.194017:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec71f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.194033:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec71f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.194051:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ec726 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.194057:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ec726 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.194063:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ec726 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.194067:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618c00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813162.194070:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ec726 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.194076:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ec726 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.194084:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff93ef10b7a700) 00010000:00010000:2.0:1788813162.194086:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813162.194089:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ec726 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.194095:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ec726 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.194109:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec72d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.194114:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec72d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.194126:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec72d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.194131:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619c00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813162.194134:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec72d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.194141:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec72d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.194169:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079d00) 00010000:00010000:2.0:1788813162.194172:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813162.194174:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec72d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.194180:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec72d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813162.194288:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1207d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+52:10455:x1875706307975040:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 2969us (3308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813162.194299:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:2.0:1788813162.212571:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813162.212613:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307975296 00000100:00100000:2.0:1788813162.212622:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307975296 00000100:00100000:2.0:1788813162.212694:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:2.0:1788813162.212707:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3645aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+52:10455:x1875706307975296:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813162.212728:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813162.212753:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec734 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2b25 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.212907:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec73b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.213052:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec73b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.213066:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec73b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813162.213080:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788813162.213663:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec73b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.213675:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec73b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.213683:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec73b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.213691:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813162.213696:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec73b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.213706:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec73b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.213721:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079d00) 00010000:00010000:2.0:1788813162.213725:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813162.213730:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec73b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.213755:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec73b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.213848:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec734 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b25 expref: 54 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.213862:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ef077b4200) 00010000:00010000:2.0:1788813162.213865:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813162.213869:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec734 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b25 expref: 54 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.213882:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619200, rc 0) 00000100:00100000:2.0:1788813162.214067:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3645aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+53:10455:x1875706307975296:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1363us (1505us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1788813162.214076:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:3.0:1788813162.218813:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813162.218864:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307975424 00000100:00100000:3.0:1788813162.218877:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307975424 00000100:00100000:3.0:1788813162.218946:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:3.0:1788813162.218958:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+53:10455:x1875706307975424:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788813162.221852:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788813162.222042:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+53:10455:x1875706307975424:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 3079us (3252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813162.226262:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:2.0:1788813162.239154:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813162.239192:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307975680 00000100:00100000:2.0:1788813162.239201:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307975680 00000100:00100000:2.0:1788813162.239257:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:2.0:1788813162.239267:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+53:10455:x1875706307975680:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813162.239287:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813162.239290:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788813162.239316:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ec6f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b17 expref: 53 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.239334:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:2.0:1788813162.239348:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813162.239363:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec749 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2b2c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788813162.240175:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788813162.240433:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec750 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.240448:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec750 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.240458:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec750 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.240513:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec749 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b2c expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.240642:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec750 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b2c expref: 54 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.240650:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93ef10b7a700) 00010000:00010000:2.0:1788813162.240653:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813162.240656:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21618600, rc 0) 00000100:00100000:2.0:1788813162.240721:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+54:10455:x1875706307975680:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1455us (1576us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788813162.240730:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:3.0:1788813162.245613:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813162.245649:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307975936 00000100:00100000:3.0:1788813162.245658:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307975936 00000100:00100000:3.0:1788813162.245705:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:3.0:1788813162.245715:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+54:10455:x1875706307975936:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788813162.245772:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813162.245814:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec750 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b2c expref: 54 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.245834:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93ef10b7a700) 00010000:00010000:3.0:1788813162.245855:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813162.245878:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec75e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.245890:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec75e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.245899:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec75e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.247260:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec765 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xd87f4e25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.247278:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec765 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd87f4e25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.247287:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec765 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd87f4e25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.247487:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec75e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.247495:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec75e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.247503:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec75e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.247509:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813162.247513:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec75e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.247533:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec75e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.247552:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:3.0:1788813162.247555:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813162.247559:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec75e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.247565:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec75e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.247576:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec765 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd87f4e25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.247582:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec765 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd87f4e25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.247588:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec765 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd87f4e25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.247593:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164ee00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813162.247596:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec765 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd87f4e25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.247602:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec765 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd87f4e25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.247609:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xd87f4e25 (ffff93ef077b4700) 00010000:00010000:3.0:1788813162.247611:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813162.247614:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec765 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd87f4e25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.247620:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec765 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd87f4e25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813162.247731:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+53:10455:x1875706307975936:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 2014us (2125us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788813162.247744:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:0.0:1788813162.266895:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000001:00080000:1.0:1788813162.267410:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000020:00080000:1.0:1788813162.267470:0:5856:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93ef2a1f4a80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788813162.267476:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ef2eff8f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93ef2a1f4d80 00000020:00080000:1.0:1788813162.267479:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ef2eff8b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93ef3697cc00 00000004:00080000:1.0:1788813162.267515:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:1.0:1788813162.267550:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788813162.267576:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788813162.267732:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788813162.270077:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307976064 00000100:00100000:3.0:1788813162.270089:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307976064 00000100:00100000:3.0:1788813162.270257:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:3.0:1788813162.270268:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1207fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+12:10455:x1875706307976064:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813162.270287:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813162.270308:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec76c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2b33 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.270344:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec773 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.270359:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.270371:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.270466:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec76c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b33 expref: 14 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.270482:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec773 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b33 expref: 13 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.270491:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93ef077b4700) 00010000:00010000:3.0:1788813162.270500:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788813162.270504:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164e000, rc 0) 00000100:00100000:3.0:1788813162.270576:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1207fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+13:10455:x1875706307976064:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 310us (3691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813162.270583:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:0.0:1788813162.274989:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788813162.275009:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322679808:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788813162.275065:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813162.275118:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322679808 00000100:00100000:0.0:1788813162.275125:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322679808 00000100:00100000:0.0:1788813162.275185:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788813162.275194:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1875706322679808:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788813162.275217:0:6676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1788813162.275260:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9f1f67, atime: 0x6a9f1f67, ctime: 0x6a9f1f67, blocks: 0x1 00010000:00010000:0.0:1788813162.275267:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba2298cc/0x1b294f297b1ec77a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.275282:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=322s v=(0 0) 00010000:00010000:0.0:1788813162.275286:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813162.275291:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba2298cc/0x1b294f297b1ec77a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.275305:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba2298cc/0x1b294f297b1ec77a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.275314:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba2298cc/0x1b294f297b1ec77a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.275321:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba2298cc/0x1b294f297b1ec77a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.275336:0:6676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788813162.275838:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3300:x1875706322679808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 644us (770us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788813162.275846:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:0.0:1788813162.275891:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ef35a1f100/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788813162.275898:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322679808:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788813162.281285:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00010000:00010000:2.0:1788813162.285083:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813162.285099:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba2298cc/0x1b294f297b1ec77a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.285130:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cf600 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:2.0:1788813162.285135:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba2298cc/0x1b294f297b1ec77a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.285161:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba2298cc/0x1b294f297b1ec77a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.285185:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba2298cc/0x1b294f297b1ec77a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.285193:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba2298cc/0x1b294f297b1ec77a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.285218:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813162.285220:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813162.285221:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813162.285241:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307976320 00000100:00100000:2.0:1788813162.285252:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307976320 00000100:00100000:2.0:1788813162.285324:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:2.0:1788813162.285335:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+13:10455:x1875706307976320:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788813162.285413:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec781 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.285427:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec781 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.285449:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec781 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788813162.288465:0:8565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1788813162.288486:0:8565:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 322674703537ns, next at 323674700115ns, rc = 0 00000004:00010000:2.0:1788813162.288614:0:8565:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032dfb461 reply state 0000000005251850 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec781 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813162.288625:0:8565:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788813162.292984:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+15:10455:x1875706307976320:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 7639us (11698us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1788813162.292997:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 75 00010000:00010000:2.0:1788813162.301251:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec781 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.301270:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec781 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.301278:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec781 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.301285:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813162.301290:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec781 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.301298:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec781 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.301315:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93ef077b4700) 00010000:00010000:2.0:1788813162.301319:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788813162.301339:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec781 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.301347:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec781 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813162.303623:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813162.306379:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307976448 00000100:00100000:3.0:1788813162.306395:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307976448 00000100:00100000:3.0:1788813162.306579:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:3.0:1788813162.306589:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+14:10455:x1875706307976448:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813162.306612:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813162.306635:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec788 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2b3a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.306700:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec788 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b3a expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.306716:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec788 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b3a expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.306735:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93ef077b4700) 00010000:00010000:3.0:1788813162.306739:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813162.306742:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164f000, rc 0) 00000100:00100000:3.0:1788813162.307443:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+15:10455:x1875706307976448:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 852us (3824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813162.307453:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:3.0:1788813162.314315:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813162.314415:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307976576 00000100:00100000:1.0:1788813162.314425:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307976576 00000100:00100000:1.0:1788813162.314479:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:1.0:1788813162.314487:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1875706307976576:12345-192.168.203.13@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788813162.314530:0:6677:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 9c560788-da9a-41fd-952d-091d96dace11@192.168.203.13@tcp t0 exp 0000000000000000 cur 322 last 0 00000020:00000080:1.0:1788813162.314559:0:6677:0:(genops.c:1384:class_connect()) connect: client 9c560788-da9a-41fd-952d-091d96dace11, cookie 0x1b294f297b1ec78f 00002000:00100000:1.0:1788813162.314570:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9c560788-da9a-41fd-952d-091d96dace11/ffff93ef217b6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788813162.314580:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788813162.314903:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788813162.315043:0:6677:0:(import.c:65:import_set_state_nolock()) ffff93ef217b5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813162.315116:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2362:x1875706307976576:12345-192.168.203.13@tcp:8:lhsmtool_posix.0 Request processed in 627us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813162.315124:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:3.0:1788813162.323283:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813162.323333:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307976704 00000100:00100000:3.0:1788813162.323343:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307976704 00000100:00100000:3.0:1788813162.323408:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:3.0:1788813162.323418:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+6:0:x1875706307976704:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788813162.323673:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813162.395118:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+7:0:x1875706307976704:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 71691us (71832us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788813162.395132:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000001:00100000:3.0:1788813162.395164:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9c560788-da9a-41fd-952d-091d96dace11 00000001:00080000:3.0:1788813162.395176:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:2.0:1788813162.400194:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813162.400349:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307976960 00000100:00100000:0.0:1788813162.400359:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307976960 00000100:00100000:0.0:1788813162.400416:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:0.0:1788813162.400426:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+15:10455:x1875706307976960:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788813162.400658:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+16:10455:x1875706307976960:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 232us (473us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788813162.400666:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:3.0:1788813162.403697:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813162.403772:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307977216 00000100:00100000:0.0:1788813162.403809:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307977216 00000100:00100000:0.0:1788813162.403860:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:0.0:1788813162.403871:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+16:10455:x1875706307977216:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788813162.403968:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+16:10455:x1875706307977216:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 99us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813162.403987:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:3.0:1788813162.413588:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813162.414132:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307977344 00000100:00100000:0.0:1788813162.414143:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307977344 00000100:00100000:0.0:1788813162.414324:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:0.0:1788813162.414335:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+16:10455:x1875706307977344:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813162.414369:0:8565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813162.414389:0:8565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ec796 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2b41 expref: -99 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.414468:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec79d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.414483:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec79d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.414494:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec79d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813162.414541:0:8565:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788813162.414562:0:8565:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec79d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.414589:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ec796 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b41 expref: 18 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.414605:0:8565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec79d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b41 expref: 17 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.414615:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93ef077b4700) 00010000:00010000:0.0:1788813162.414618:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788813162.414622:0:8565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190ce800, rc 0) 00000100:00100000:0.0:1788813162.414675:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+17:10455:x1875706307977344:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 343us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813162.414682:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:2.0:1788813162.424543:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813162.424623:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307977472 00000100:00100000:1.0:1788813162.424633:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307977472 00000100:00100000:1.0:1788813162.424690:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:1.0:1788813162.424701:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+5:2365:x1875706307977472:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813162.424719:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813162.424743:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a54d8a6f/0x1b294f297b1ec7a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2b48 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788813162.424770:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f1f6a, blocks: 0x1 00010000:00010000:1.0:1788813162.424834:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=322s v=(0 0) 00010000:00010000:1.0:1788813162.424840:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813162.424849:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a54d8a6f/0x1b294f297b1ec7a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b48 expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.424873:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a54d8a6f/0x1b294f297b1ec7a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b48 expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.424885:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fce00, rc 0) 00000100:00100000:1.0:1788813162.424951:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2365:x1875706307977472:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 252us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813162.424959:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:3.0:1788813162.434595:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813162.436613:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307977728 00000100:00100000:0.0:1788813162.436626:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307977728 00000100:00100000:0.0:1788813162.436709:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:0.0:1788813162.436720:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+17:10455:x1875706307977728:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788813162.436876:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+17:10455:x1875706307977728:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 157us (4099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813162.436883:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:0.0:1788813162.444485:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813162.446198:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307977856 00000100:00100000:2.0:1788813162.446211:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307977856 00000100:00100000:2.0:1788813162.446282:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:2.0:1788813162.446293:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36adce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+6:10455:x1875706307977856:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813162.446316:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813162.446339:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ec7ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2b4f expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.446372:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a54d8a6f/0x1b294f297b1ec7a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b48 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.446382:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813162.446386:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813162.446392:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ec7ab lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b4f expref: 7 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.446429:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a54d8a6f/0x1b294f297b1ec7a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b48 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.446442:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a54d8a6f/0x1b294f297b1ec7a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b48 expref: 7 pid: 6677 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813162.446470:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3645a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6675:1875706322679936:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788813162.446593:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef19c80300 going to sleep for 11 seconds 00000100:00100000:0.0:1788813162.450119:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3645a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6675:1875706322679936:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788813162.450154:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ec7ab lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b4f expref: 7 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.450174:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619e00, rc 0) 00000100:00100000:0.0:1788813162.450236:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36adce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+7:10455:x1875706307977856:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 3944us (5759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813162.450245:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:1.0:1788813162.453127:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813162.453741:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307977984 00000100:00100000:3.0:1788813162.453759:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307977984 00010000:00010000:3.0:1788813162.453867:0:8439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a54d8a6f/0x1b294f297b1ec7a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b48 expref: 7 pid: 6677 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813162.453918:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:3.0:1788813162.453945:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef121e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+7:2365:x1875706307977984:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813162.453974:0:8439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813162.454003:0:8439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a54d8a6f/0x1b294f297b1ec7a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b48 expref: 7 pid: 6677 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.454019:0:8439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a54d8a6f/0x1b294f297b1ec7a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b48 expref: 7 pid: 6677 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.454073:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a54d8a6f/0x1b294f297b1ec7a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b48 expref: 7 pid: 6677 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.454096:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813162.454101:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813162.454109:0:8439:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ec7ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b4f expref: 6 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.454119:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ec7ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b4f expref: 6 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.454168:0:8439:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ec7ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b4f expref: 6 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813162.454185:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8439:1875706322680064:192.168.203.13@tcp:105: 00000100:00100000:3.0:1788813162.454295:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef23db5600 going to sleep for 11 seconds 00010000:00010000:2.0:1788813162.461296:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813162.467562:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8439:1875706322680064:192.168.203.13@tcp:105: 00010000:00010000:2.0:1788813162.467590:0:8439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813162.467655:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef121e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+6:2365:x1875706307977984:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 13718us (14538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813162.467666:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:2.0:1788813162.491197:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813162.491294:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307978112 00000100:00100000:0.0:1788813162.491313:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307978112 00002000:00100000:0.0:1788813162.491385:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff93ef36459500 x1875706307978112/t0(0) o4->9c560788-da9a-41fd-952d-091d96dace11@192.168.203.13@tcp:733/0 lens 504/0 e 0 to 0 dl 1788813173 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788813162.491398:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93ef36459500 with x1875706307978112 ext(0->8) 00002000:00010000:0.0:1788813162.491405:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ef36459500 00000100:00100000:0.0:1788813162.491443:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:0.0:1788813162.491455:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2365:x1875706307978112:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788813162.503098:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9c560788-da9a-41fd-952d-091d96dace11+8:2365:x1875706307978112:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 Request processed in 11636us (11902us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788813162.503117:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00002000:00100000:1.0:1788813162.503130:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff93ef36459500 x1875706307978112/t4294967302(0) o4->9c560788-da9a-41fd-952d-091d96dace11@192.168.203.13@tcp:733/0 lens 504/448 e 0 to 0 dl 1788813173 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788813162.503147:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93ef36459500 with x1875706307978112 ext(0->8) 00002000:00010000:1.0:1788813162.503154:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ef36459500 00000100:00100000:1.0:1788813162.509825:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813162.513600:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307978240 00000100:00100000:0.0:1788813162.513631:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307978240 00000100:00100000:0.0:1788813162.513706:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:0.0:1788813162.513717:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+17:10455:x1875706307978240:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788813162.570167:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+17:10455:x1875706307978240:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 56442us (60341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813162.570179:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 80 00000001:00080000:1.0:1788813162.571825:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:1.0:1788813162.571845:0:5856:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:1.0:1788813162.571856:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788813162.571934:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1788813162.571955:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788813162.572880:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322680192:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788813162.572952:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813162.573666:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322680192 00000100:00100000:1.0:1788813162.573675:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322680192 00000100:00100000:1.0:1788813162.573756:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788813162.573766:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322680192:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788813162.574531:0:6677:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788813162.574536:0:6677:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788813162 00002000:00010000:1.0:1788813162.574539:0:6677:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788813162.574541:0:6677:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788813162 -> 1788813162 00002000:00010000:1.0:1788813162.574543:0:6677:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788813162.574615:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1875706322680192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 849us (1661us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788813162.574624:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1788813162.574767:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ef36458000/2, rc 0, transno 4294967303 00000100:00100000:1.0:1788813162.574775:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322680192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788813162.576588:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813162.576634:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307978368 00000100:00100000:2.0:1788813162.576643:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307978368 00000100:00100000:2.0:1788813162.576696:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:2.0:1788813162.576706:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+8:2365:x1875706307978368:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788813162.638865:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1788813162.638885:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1788813162.639474:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+6:2365:x1875706307978368:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 62763us (63083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813162.639486:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:2.0:1788813162.643024:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813162.643234:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307978624 00000100:00100000:0.0:1788813162.643244:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307978624 00000100:00100000:0.0:1788813162.643301:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:0.0:1788813162.643310:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3645b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+13:10455:x1875706307978624:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788813162.643358:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813162.643384:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec79d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b41 expref: 13 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.643401:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93ef077b4700) 00010000:00010000:0.0:1788813162.643406:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813162.643574:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec7b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.643589:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec7b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.643599:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec7b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813162.644201:0:7630:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1e4bf88 reply state 00000000d501dab0 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec7b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813162.644218:0:7630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788813162.644326:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3645b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+14:10455:x1875706307978624:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 1015us (1410us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788813162.644334:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 81 00010000:00010000:2.0:1788813162.647392:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec7b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.647408:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec7b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.647416:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec7b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.647423:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190ce200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813162.647428:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec7b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.647448:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec7b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.647463:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93ef077b4700) 00010000:00010000:2.0:1788813162.647467:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813162.647472:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec7b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.647478:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec7b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813162.649684:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813162.649948:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307978752 00000100:00100000:3.0:1788813162.649969:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307978752 00000100:00100000:3.0:1788813162.650014:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:3.0:1788813162.650023:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36459180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+6:2365:x1875706307978752:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788813162.650686:0:8122:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788813162.650692:0:8122:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788813162 -> 1788813161 00002000:00010000:3.0:1788813162.650700:0:8122:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788813159 00002000:00010000:3.0:1788813162.650702:0:8122:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788813162 -> 1788813161 00002000:00010000:3.0:1788813162.650704:0:8122:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788813162.650855:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36459180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+7:2365:x1875706307978752:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 831us (1176us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788813162.650863:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:3.0:1788813162.657659:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813162.657768:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307979008 00000100:00100000:0.0:1788813162.657813:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307979008 00000100:00100000:0.0:1788813162.657860:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:0.0:1788813162.657869:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+13:10455:x1875706307979008:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788813162.657932:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec7b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.657950:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec773 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b33 expref: 13 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.657959:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec7b9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.657993:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec773 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b33 expref: 13 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.658006:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec773 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b33 expref: 13 pid: 7630 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813162.658020:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36add500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875706322680320:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788813162.658117:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef21238180 going to sleep for 11 seconds 00000100:00100000:3.0:1788813162.661203:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813162.661462:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307979136 00000100:00100000:0.0:1788813162.661477:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307979136 00010000:00010000:0.0:1788813162.661529:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec773 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b33 expref: 14 pid: 7630 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813162.661571:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:0.0:1788813162.661581:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+14:2365:x1875706307979136:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813162.661594:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813162.661601:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec773 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b33 expref: 14 pid: 7630 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.661623:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec773 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b33 expref: 14 pid: 7630 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.661645:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93ef077b4700) 00010000:00010000:0.0:1788813162.661651:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec7b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.661661:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec7b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.661669:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec7b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.661686:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813162.661738:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+14:2365:x1875706307979136:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 159us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813162.661746:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00010000:00010000:2.0:1788813162.663590:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec773 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b33 expref: 13 pid: 7630 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813162.663622:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36add500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875706322680320:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788813162.663645:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec7b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.663768:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec7b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.663777:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec7b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.664152:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec7b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.664161:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec7b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.664167:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec7b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.664173:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190ce800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813162.664178:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec7b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.664186:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec7b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.664202:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93ef077b4700) 00010000:00010000:3.0:1788813162.664211:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788813162.664217:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec7b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.664223:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec7b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813162.664342:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+12:10455:x1875706307979008:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 Request processed in 6471us (6690us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788813162.664352:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:2.0:1788813162.667387:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813162.667510:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307979264 00000100:00100000:0.0:1788813162.667528:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307979264 00000100:00100000:0.0:1788813162.667599:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:0.0:1788813162.667609:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+7:2366:x1875706307979264:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788813162.667653:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004d494528/0x1b294f297b1ec7c0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.668026:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ec7ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b4f expref: 7 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.668036:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788813162.668040:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813162.668045:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d494528/0x1b294f297b1ec7c0 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.668078:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ec7ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b4f expref: 7 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.668090:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ec7ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b4f expref: 7 pid: 6675 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813162.668104:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36adc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6675:1875706322680448:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788813162.668186:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef21238f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813162.672830:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813162.672862:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307979392 00000100:00100000:1.0:1788813162.672870:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307979392 00010000:00010000:1.0:1788813162.672905:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ec7ab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b4f expref: 8 pid: 6675 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813162.672942:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:1.0:1788813162.672951:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21247800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+8:2365:x1875706307979392:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813162.672965:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813162.672987:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ec7ab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b4f expref: 8 pid: 6675 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.673001:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ec7ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b4f expref: 8 pid: 6675 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.673027:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788813162.673032:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788813162.673038:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004d494528/0x1b294f297b1ec7c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.673047:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d494528/0x1b294f297b1ec7c0 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.673067:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813162.673115:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21247800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+8:2365:x1875706307979392:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 164us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813162.673123:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00010000:00010000:1.0:1788813162.673999:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ec7ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b4f expref: 7 pid: 6675 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813162.674014:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36adc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6675:1875706322680448:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788813162.674034:0:6675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004d494528/0x1b294f297b1ec7c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.674045:0:6675:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004d494528/0x1b294f297b1ec7c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.674051:0:6675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d494528/0x1b294f297b1ec7c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.674077:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004d494528/0x1b294f297b1ec7c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.674086:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d494528/0x1b294f297b1ec7c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.674094:0:6675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d494528/0x1b294f297b1ec7c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.674101:0:6675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cfe00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:1.0:1788813162.674105:0:6675:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d494528/0x1b294f297b1ec7c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.674128:0:6675:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d494528/0x1b294f297b1ec7c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.674141:0:6675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d494528/0x1b294f297b1ec7c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.674148:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d494528/0x1b294f297b1ec7c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813162.674213:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+6:2366:x1875706307979264:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 6604us (6833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813162.674286:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 32 00000040:00080000:1.0:1788813162.676198:0:11998:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788813162.676208:0:11998:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788813162.678665:0:11998:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788813162.678977:0:11998:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788813162.685607:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813162.685896:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307979648 00000100:00100000:1.0:1788813162.685906:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307979648 00000100:00100000:1.0:1788813162.685964:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:1.0:1788813162.685975:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+12:10455:x1875706307979648:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788813162.686055:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ec7c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.686074:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ec7c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.686097:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ec7c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.686302:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ec7ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.686315:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec788 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b3a expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.686324:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ec7ce lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.686357:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec788 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b3a expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.686370:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec788 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b3a expref: 13 pid: 5834 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813162.686384:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef21244380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875706322680576:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788813162.686478:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a1f4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813162.690982:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef21244380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875706322680576:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788813162.691013:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ec7ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813162.691858:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813162.691916:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307979776 00000100:00100000:3.0:1788813162.691931:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307979776 00010000:00010000:3.0:1788813162.691971:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec788 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b3a expref: 14 pid: 5834 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813162.692012:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:3.0:1788813162.692063:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21244380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+14:2365:x1875706307979776:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813162.692088:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813162.692095:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec788 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b3a expref: 14 pid: 5834 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.692108:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec788 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b3a expref: 14 pid: 5834 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.692128:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec788 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b3a expref: 14 pid: 5834 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.692143:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93ef077b4700) 00010000:00010000:3.0:1788813162.692155:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ec7ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.692164:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ec7ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.692172:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ec7ce lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.692199:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813162.692262:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21244380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+13:2365:x1875706307979776:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 202us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813162.692269:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00010000:00010000:1.0:1788813162.692872:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ec7ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.692894:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ec7ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788813162.693091:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1788813162.693235:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1788813162.693281:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1788813162.693375:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef21247480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1875706322680704:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788813162.693628:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813162.694474:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a1f4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813162.694561:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322680704 00000100:00100000:2.0:1788813162.694569:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322680704 00000100:00100000:2.0:1788813162.694724:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788813162.694735:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3c6ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1875706322680704:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788813162.694865:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3c6ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1875706322680704:12345-0@lo:1000:mdt00_001.0 Request processed in 132us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813162.694871:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813162.694962:0:5835:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1788813162.694968:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ef36458000, transno 4294967303 00000100:00100000:1.0:1788813162.694982:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef21247480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1875706322680704:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788813162.695452:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1788813162.695531:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3c6eed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1875706322680832:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788813162.695565:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813162.696394:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a1f4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813162.696441:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322680832 00000100:00100000:3.0:1788813162.696448:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322680832 00000100:00100000:3.0:1788813162.696483:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788813162.696491:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3c6ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1875706322680832:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788813162.697329:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3c6ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1875706322680832:12345-0@lo:1000:mdt00_001.0 Request processed in 838us (1762us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788813162.697338:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788813162.697401:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3c6eed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1875706322680832:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788813162.697438:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ec7ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.697448:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ec7ce lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.697454:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ec7ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.697469:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fd800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813162.697473:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ec7ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.697481:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ec7ce lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.697495:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93ef077b4700) 00010000:00010000:3.0:1788813162.697498:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813162.697503:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ec7ce lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.697508:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ec7ce lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.697732:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec6fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.697884:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec6fc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.697892:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec6fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.697896:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cf800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813162.697899:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec6fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.697905:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec6fc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.697995:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079d00) 00010000:00010000:3.0:1788813162.697998:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813162.698002:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec6fc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.698009:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec6fc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.698031:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec7d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.698046:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ec718 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b1e expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.698055:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec7d5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.698161:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ec718 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b1e expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.698176:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ec718 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b1e expref: 16 pid: 5835 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813162.698189:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875706322680960:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788813162.698505:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef35603240 going to sleep for 11 seconds 00000100:00100000:2.0:1788813162.703535:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813162.703588:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307979904 00000100:00100000:1.0:1788813162.703597:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307979904 00010000:00010000:1.0:1788813162.703636:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ec718 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b1e expref: 17 pid: 5835 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813162.703718:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875706322680960:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788813162.703751:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec7d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813162.703907:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:2.0:1788813162.703919:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36458000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+17:2366:x1875706307979904:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813162.703933:0:8439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813162.703940:0:8439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ec718 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b1e expref: 17 pid: 5835 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.703953:0:8439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ec718 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b1e expref: 17 pid: 5835 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.703975:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ec718 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b1e expref: 17 pid: 5835 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.703989:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079d00) 00010000:00010000:2.0:1788813162.703994:0:8439:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec7d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.704004:0:8439:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec7d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.704012:0:8439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec7d5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813162.704044:0:8439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813162.704075:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec7d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.704083:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec7d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.704096:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec7d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.704111:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec7d5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.704117:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec7d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.704123:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813162.704128:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec7d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.704136:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec7d5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.704145:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079d00) 00010000:00010000:0.0:1788813162.704148:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813162.704152:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec7d5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.704158:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec7d5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.704169:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ec7c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.704174:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ec7c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.704179:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ec7c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.704183:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fd000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813162.704192:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ec7c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.704199:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ec7c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.704207:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef1a079d00) 00010000:00010000:0.0:1788813162.704209:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788813162.704212:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ec7c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813162.704218:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ec7c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813162.704420:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+16:10455:x1875706307979648:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 18445us (18821us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1788813162.704430:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 83 00000020:00080000:0.0:1788813162.704435:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788813162.704555:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813162.704560:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813162.704586:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788813162.704592:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788813162.705320:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36458000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+15:2366:x1875706307979904:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 1324us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813162.705331:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:2.0:1788813162.711230:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813162.711499:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307980160 00000100:00100000:3.0:1788813162.711510:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307980160 00000100:00100000:3.0:1788813162.711576:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:3.0:1788813162.711586:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+15:10455:x1875706307980160:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788813162.712616:0:5838:0:(mdd_object.c:4199:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788813162.713504:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1788813162.713587:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec7dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.713606:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec7dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.713618:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec7dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.713627:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec7dc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.713633:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec7dc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.713639:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec7dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813162.713667:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813162.713836:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813162.713843:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec7dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.713850:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f800 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:1.0:1788813162.713855:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec7dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.713874:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec7dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.713887:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93ef077b4700) 00010000:00010000:1.0:1788813162.713889:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788813162.713894:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec7dc lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.713900:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec7dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813162.713917:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813162.713919:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813162.713931:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813162.716832:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+17:10455:x1875706307980160:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 5238us (5602us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788813162.716846:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000020:00080000:3.0:1788813162.716854:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788813163.471335:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813163.471390:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813163.471808:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307980416 00000100:00100000:2.0:1788813163.471818:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307980416 00000100:00100000:2.0:1788813163.471896:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 133 00000100:00100000:2.0:1788813163.471917:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+17:2363:x1875706307980416:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813163.472011:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+17:2363:x1875706307980416:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 95us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813163.472018:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 133 00000100:00100000:0.0:1788813163.474181:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307980288 00000100:00100000:0.0:1788813163.474195:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307980288 00000100:00100000:0.0:1788813163.474268:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 286 00000100:00100000:0.0:1788813163.474279:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+13:2363:x1875706307980288:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813163.474358:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+13:2363:x1875706307980288:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 81us (3033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813163.474365:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 286 00000100:00100000:3.0:1788813163.481745:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813163.482001:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307980672 00000100:00100000:1.0:1788813163.482012:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307980672 00000100:00100000:1.0:1788813163.482073:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:1.0:1788813163.482092:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2364:x1875706307980672:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813163.482169:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2364:x1875706307980672:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 80us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813163.482176:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:2.0:1788813163.483144:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813163.483183:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813163.483307:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307980800 00000100:00100000:3.0:1788813163.483314:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307980800 00000100:00100000:3.0:1788813163.483377:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 134 00000100:00100000:3.0:1788813163.483386:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3645a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2363:x1875706307980800:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813163.483439:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3645a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2363:x1875706307980800:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 55us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813163.483447:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 134 00000100:00080000:0.0:1788813163.483590:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813163.483719:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307980544 00000100:00100000:1.0:1788813163.483725:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307980544 00000100:00100000:1.0:1788813163.483775:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:1.0:1788813163.483816:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3645b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+7:2363:x1875706307980544:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813163.483863:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3645b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+7:2363:x1875706307980544:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 81us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813163.483879:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00080000:0.0:1788813163.484022:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788813163.485043:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788813163.741035:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813163.741044:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813163.741074:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788813163.741081:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788813164.508879:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788813164.721238:0:12049:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788813164.721247:0:12049:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788813164.721282:0:12049:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788813164.721288:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1788813164.801913:0:6700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:1.0:1788813164.801934:0:6700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1788813164.867948:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813164.868018:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307981056 00000100:00100000:3.0:1788813164.868028:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307981056 00000100:00100000:3.0:1788813164.868111:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:3.0:1788813164.868122:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+17:10473:x1875706307981056:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813164.868142:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813164.868162:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec7e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2b56 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.868251:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec7ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.868267:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec7ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.868280:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec7ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813164.868489:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788813164.868627:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec7e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b56 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.868644:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec7ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b56 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.868652:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:3.0:1788813164.868655:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788813164.868658:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164ee00, rc 0) 00000100:00100000:3.0:1788813164.868714:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+19:10473:x1875706307981056:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 593us (772us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1788813164.868722:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00080000:2.0:1788813164.869819:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813164.875484:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813164.875692:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307981184 00000100:00100000:3.0:1788813164.875702:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307981184 00000100:00100000:3.0:1788813164.875758:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:3.0:1788813164.875768:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+19:10473:x1875706307981184:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:3.0:1788813164.875875:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec7f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.875893:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec7f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.875905:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec7f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.875919:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec7ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.875935:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec7ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.875943:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec7ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.876185:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec806 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.876194:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.876201:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813164.876235:0:8565:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.876247:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec7f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.876253:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec7f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.876259:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec7f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.876264:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813164.876268:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec7f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.876276:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec7f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.876294:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:3.0:1788813164.876297:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813164.876313:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec7f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.876320:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec7f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.876333:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec7ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.876339:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec7ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.876345:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec7ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.876350:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813164.876353:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec7ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.876359:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec7ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.876367:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ef077b4b00) 00010000:00010000:3.0:1788813164.876370:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813164.876373:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec7ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.876379:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec7ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.876402:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.876407:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec806 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.876413:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec806 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.876417:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813164.876677:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec806 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.876687:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec806 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.876696:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef077b4a00) 00010000:00010000:3.0:1788813164.876699:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813164.876702:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec806 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.876708:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec806 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813164.876815:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+19:10473:x1875706307981184:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 1045us (1337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813164.876824:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:3.0:1788813164.949311:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813164.949498:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307981440 00000100:00100000:2.0:1788813164.949520:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307981440 00000100:00100000:2.0:1788813164.949597:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:2.0:1788813164.949680:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+19:10476:x1875706307981440:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813164.949710:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813164.949742:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ec80d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2b5d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813164.949889:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec814 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813164.949908:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec814 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813164.949924:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec814 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813164.949943:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ec81b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813164.950206:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ec81b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813164.950215:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ec81b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813164.951207:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec822 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813164.951222:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813164.951232:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813164.951244:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788813164.951375:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec814 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813164.951383:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec814 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813164.951391:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec814 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813164.951397:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619c00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813164.952519:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec814 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813164.952534:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec814 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813164.952578:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:2.0:1788813164.952582:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813164.952588:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec814 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813164.952596:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec814 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813164.952723:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ec81b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813164.952731:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ec81b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813164.952739:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ec81b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813164.952746:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618c00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813164.952750:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ec81b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813164.952756:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ec81b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813164.952765:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ef10b7af00) 00010000:00010000:2.0:1788813164.952767:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813164.952770:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ec81b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813164.952776:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ec81b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813164.953209:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ec80d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b5d expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813164.953231:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b5d expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813164.953240:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef10b7ab00) 00010000:00010000:2.0:1788813164.953242:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813164.953245:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21618600, rc 0) 00000100:00100000:2.0:1788813164.953746:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+21:10476:x1875706307981440:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 4135us (4447us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788813164.953758:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:2.0:1788813164.970235:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813164.970720:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307981568 00000100:00100000:3.0:1788813164.970735:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307981568 00000100:00100000:3.0:1788813164.970873:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00100000:3.0:1788813164.970884:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+21:10476:x1875706307981568:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:3.0:1788813164.971543:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec830 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.971565:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.971580:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.972072:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.972084:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec830 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.972092:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec830 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.972099:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef421e9c00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813164.972105:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec830 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.972113:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec830 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.972129:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef10b7ab00) 00010000:00010000:3.0:1788813164.972132:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813164.972138:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec830 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813164.972163:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec830 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813164.972284:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+21:10476:x1875706307981568:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 1397us (2059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813164.972294:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00100000:0.0:1788813164.977601:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813164.977715:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307981824 00000100:00100000:2.0:1788813164.977731:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307981824 00000100:00100000:2.0:1788813164.977848:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:2.0:1788813164.977861:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef0e7f8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+21:10476:x1875706307981824:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788813164.978194:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef0e7f8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+22:10476:x1875706307981824:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 335us (735us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788813164.978202:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:0.0:1788813165.038893:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813165.039003:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307982080 00000100:00100000:3.0:1788813165.039013:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307982080 00000100:00100000:3.0:1788813165.039143:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:3.0:1788813165.039154:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+22:9996:x1875706307982080:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1788813165.039177:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813165.039197:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec837 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2b64 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.039298:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec83e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.039312:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec822 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b5d expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.039320:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec83e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.039353:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b5d expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.039367:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec822 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b5d expref: 23 pid: 5834 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813165.039395:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875706322681088:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788813165.040718:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef113a9240 going to sleep for 11 seconds 00000100:00100000:0.0:1788813165.044942:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875706322681088:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788813165.044981:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec83e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813165.045455:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813165.045583:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307982208 00000100:00100000:3.0:1788813165.045591:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307982208 00010000:00010000:3.0:1788813165.045632:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec822 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b5d expref: 24 pid: 5834 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813165.045670:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:3.0:1788813165.045680:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36add180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+24:2366:x1875706307982208:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813165.045693:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813165.045700:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec822 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b5d expref: 24 pid: 5834 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.045726:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b5d expref: 24 pid: 5834 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.045748:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ec822 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b5d expref: 24 pid: 5834 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.045762:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef10b7ab00) 00010000:00010000:3.0:1788813165.045767:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec83e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.045776:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec83e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.045835:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec83e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.045854:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813165.045890:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec83e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.045899:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec83e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813165.045913:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36add180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+23:2366:x1875706307982208:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 227us (453us total) trans 0 rc 0/0 00000004:00200000:0.0:1788813165.045916:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00000100:00100000:3.0:1788813165.045920:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00010000:00010000:0.0:1788813165.046054:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec837 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b64 expref: 24 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.046070:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec83e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b64 expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.046077:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef10b7ab00) 00010000:00010000:0.0:1788813165.046080:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788813165.046082:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef421e9c00, rc 0) 00000100:00100000:0.0:1788813165.046110:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+23:9996:x1875706307982080:12345-192.168.203.13@tcp:101:bash.0 Request processed in 6959us (7225us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788813165.046126:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:3.0:1788813165.049546:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813165.049685:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307982464 00000100:00100000:2.0:1788813165.049696:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307982464 00000100:00100000:2.0:1788813165.049767:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 89 00000100:00100000:2.0:1788813165.049819:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+23:9996:x1875706307982464:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:2.0:1788813165.050093:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec84c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.050123:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec84c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.050136:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec84c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788813165.050188:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1788813165.050213:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000077525071 reply state 000000001bf08c26 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec84c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813165.050222:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788813165.050264:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1788813165.050363:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+27:9996:x1875706307982464:12345-192.168.203.13@tcp:36:bash.0 Request processed in 546us (827us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1788813165.050371:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 89 00000020:00080000:2.0:1788813165.050376:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788813165.053088:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec84c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.053105:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec84c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.053113:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec84c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.053118:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619c00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813165.053123:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec84c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.053130:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec84c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.053145:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef10b7ab00) 00010000:00010000:3.0:1788813165.053148:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813165.053153:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec84c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.053159:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec84c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813165.054896:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813165.055277:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307982592 00000100:00100000:2.0:1788813165.055291:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307982592 00000100:00100000:2.0:1788813165.055352:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:2.0:1788813165.055361:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+26:9996:x1875706307982592:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1788813165.055385:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813165.055403:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec853 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2b6b expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.055474:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec853 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b6b expref: 27 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.055491:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec853 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b6b expref: 27 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.055539:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef10b7ab00) 00010000:00010000:2.0:1788813165.055542:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788813165.055546:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21618400, rc 0) 00000100:00100000:2.0:1788813165.055605:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+27:9996:x1875706307982592:12345-192.168.203.13@tcp:101:bash.0 Request processed in 244us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813165.055613:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:2.0:1788813165.060519:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813165.060918:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307982720 00000100:00100000:1.0:1788813165.060928:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307982720 00000100:00100000:1.0:1788813165.061001:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:1.0:1788813165.061012:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3645b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+6:9996:x1875706307982720:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788813165.061028:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813165.061049:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f35b4e2/0x1b294f297b1ec85a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2b72 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788813165.061075:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f1f69, atime: 0x6a9f1f67, ctime: 0x6a9f1f69, blocks: 0xb 00010000:00010000:1.0:1788813165.061096:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=325s v=(0 0) 00010000:00010000:1.0:1788813165.061101:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813165.061109:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f35b4e2/0x1b294f297b1ec85a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b72 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.061126:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004f35b4e2/0x1b294f297b1ec85a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b72 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788813165.061139:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788813165.061139:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fdc00, rc 0) 00000100:00100000:1.0:1788813165.061198:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3645b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+7:9996:x1875706307982720:12345-192.168.203.13@tcp:101:bash.0 Request processed in 187us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813165.061205:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:0.0:1788813165.066901:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813165.067032:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307982848 00000100:00100000:3.0:1788813165.067042:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307982848 00002000:00010000:3.0:1788813165.067093:0:6681:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1788813165.067098:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93ef36adc700 with x1875706307982848 ext(0->18446744073709551615) 00002000:00010000:3.0:1788813165.067109:0:6681:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ef36adc700. 00000100:00100000:3.0:1788813165.067139:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:3.0:1788813165.067149:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9c560788-da9a-41fd-952d-091d96dace11+7:2365:x1875706307982848:12345-192.168.203.13@tcp:10:bash.0 00002000:00010000:3.0:1788813165.067413:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788813165.067417:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788813161 -> 1788813165 00002000:00010000:3.0:1788813165.067420:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788813159 -> 1788813159 00002000:00010000:3.0:1788813165.067423:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788813161 -> 1788813165 00002000:00010000:3.0:1788813165.067426:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788813165.067507:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9c560788-da9a-41fd-952d-091d96dace11+8:2365:x1875706307982848:12345-192.168.203.13@tcp:10:bash.0 Request processed in 350us (606us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788813165.067515:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00002000:00010000:3.0:1788813165.067518:0:6681:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1788813165.067521:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93ef36adc700 with x1875706307982848 ext(0->18446744073709551615) 00002000:00010000:3.0:1788813165.067526:0:6681:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ef36adc700. 00000100:00100000:3.0:1788813165.151265:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813165.151967:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307982976 00000100:00100000:0.0:1788813165.151979:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307982976 00000100:00100000:0.0:1788813165.152044:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:0.0:1788813165.152054:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+27:10490:x1875706307982976:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:0.0:1788813165.152123:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ec861 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152141:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ec861 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152152:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ec861 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152166:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec868 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152172:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152178:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152405:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec86f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152414:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec86f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152421:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec86f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813165.152467:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec86f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152478:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ec861 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152485:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ec861 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152491:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ec861 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152497:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cf000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813165.152515:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ec861 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152523:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ec861 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152535:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:0.0:1788813165.152538:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813165.152543:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ec861 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152549:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ec861 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152562:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152568:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec868 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152579:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec868 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152584:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cf800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813165.152586:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec868 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152591:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec868 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152598:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ef1a079d00) 00010000:00010000:0.0:1788813165.152600:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813165.152603:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec868 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152608:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec868 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152621:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec86f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152626:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec86f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152631:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec86f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152635:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cfc00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813165.152638:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec86f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152652:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec86f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152658:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef10b7ab00) 00010000:00010000:0.0:1788813165.152660:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813165.152663:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec86f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.152669:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec86f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813165.152756:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+27:10490:x1875706307982976:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 703us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813165.152764:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:0.0:1788813165.231233:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813165.231409:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307983232 00000100:00100000:3.0:1788813165.231418:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307983232 00000100:00100000:3.0:1788813165.231541:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 92 00000100:00100000:3.0:1788813165.231552:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+27:10493:x1875706307983232:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813165.231571:0:8565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813165.231612:0:8565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec876 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2b79 expref: -99 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.231696:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec87d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.231722:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec87d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.231734:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec87d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.231750:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec884 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.231757:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec884 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.231764:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec884 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.232015:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec88b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.232025:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec88b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.232034:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec88b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813165.232058:0:8565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788813165.232144:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec87d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.232163:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec87d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.232169:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec87d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.232175:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef421e8c00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813165.232179:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec87d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.232186:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec87d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.232199:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:3.0:1788813165.232202:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813165.232207:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec87d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.232213:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec87d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.232226:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec884 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.232232:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec884 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.232238:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec884 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.232244:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813165.232252:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec884 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.232258:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec884 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.232265:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ef077b4a00) 00010000:00010000:3.0:1788813165.232267:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813165.232270:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec884 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.232276:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec884 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.233646:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec876 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b79 expref: 30 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.233680:0:8565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec88b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b79 expref: 29 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.233689:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef10b7ab00) 00010000:00010000:3.0:1788813165.233691:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788813165.233695:0:8565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164e000, rc 0) 00000100:00100000:3.0:1788813165.236195:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+29:10493:x1875706307983232:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 4634us (4960us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788813165.236208:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 92 00000100:00100000:3.0:1788813165.239724:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813165.239878:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307983360 00000100:00100000:2.0:1788813165.239889:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307983360 00000100:00100000:2.0:1788813165.239947:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:2.0:1788813165.239958:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+29:10493:x1875706307983360:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:2.0:1788813165.240040:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec899 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.240058:0:7630:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec83e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b64 expref: 29 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.240068:0:7630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec899 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.240102:0:7630:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec83e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b64 expref: 29 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.240116:0:7630:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec83e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b64 expref: 29 pid: 5836 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813165.240151:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36459c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7630:1875706322681216:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788813165.240262:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e11c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788813165.242914:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36459c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7630:1875706322681216:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788813165.242946:0:7630:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec899 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813165.243137:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813165.243354:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307983616 00000100:00100000:2.0:1788813165.243361:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307983616 00000100:00100000:2.0:1788813165.243414:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:2.0:1788813165.243422:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+30:5598:x1875706307983616:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788813165.243744:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+31:5598:x1875706307983616:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 320us (607us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788813165.243752:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:0.0:1788813165.245854:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813165.249045:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307983744 00000100:00100000:2.0:1788813165.249059:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307983744 00010000:00010000:2.0:1788813165.249107:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec83e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b64 expref: 31 pid: 5836 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813165.249159:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:2.0:1788813165.249169:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36adf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+31:2366:x1875706307983744:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813165.249182:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813165.249190:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec83e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b64 expref: 31 pid: 5836 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.249221:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec83e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b64 expref: 31 pid: 5836 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.249243:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec83e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b64 expref: 31 pid: 5836 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.249261:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef10b7ab00) 00010000:00010000:2.0:1788813165.249267:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec899 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.249275:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec899 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.249282:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec899 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.249317:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813165.249381:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36adf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+30:2366:x1875706307983744:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 213us (3535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813165.249388:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00010000:00010000:0.0:1788813165.250190:0:7630:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec899 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.250201:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec899 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.250236:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec899 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.250242:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec899 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.250249:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec899 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.250270:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813165.250274:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec899 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.250283:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec899 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.250294:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef10b7ab00) 00010000:00010000:0.0:1788813165.250297:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788813165.250301:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec899 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.250306:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec899 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813165.250371:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+29:10493:x1875706307983360:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 10414us (10655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813165.250379:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:0.0:1788813165.253718:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813165.253831:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307984000 00000100:00100000:2.0:1788813165.253841:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307984000 00000100:00100000:2.0:1788813165.253900:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:2.0:1788813165.253910:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+29:10493:x1875706307984000:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788813165.254373:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+30:10493:x1875706307984000:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 463us (662us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788813165.254382:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:2.0:1788813165.395104:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813165.395295:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307984256 00000100:00100000:0.0:1788813165.395309:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307984256 00000100:00100000:0.0:1788813165.395389:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00100000:0.0:1788813165.395400:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+30:10504:x1875706307984256:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:0.0:1788813165.395549:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813165.395579:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ec8a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2b80 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.395673:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec8a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.395706:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec8a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.395720:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec8a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.395739:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec8ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.395746:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec8ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.395752:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec8ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.396380:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec8b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.396393:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.396401:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813165.396411:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788813165.397574:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec8a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.397592:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec8a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.397601:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec8a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.397623:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cfe00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813165.397629:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec8a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.397637:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec8a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.397656:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:0.0:1788813165.397660:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813165.397667:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec8a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.397673:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec8a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.397691:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec8ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.397697:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec8ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.397703:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec8ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.397708:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190ce800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813165.397711:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec8ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.397717:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec8ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.397738:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ef1a079d00) 00010000:00010000:0.0:1788813165.397741:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813165.397745:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec8ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.397750:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec8ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.398886:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ec8a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b80 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.398919:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec8b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b80 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.398928:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef10b7ab00) 00010000:00010000:0.0:1788813165.398930:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813165.398934:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cee00, rc 0) 00000100:00100000:0.0:1788813165.399151:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+32:10504:x1875706307984256:12345-192.168.203.13@tcp:101:cat.0 Request processed in 3751us (4059us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788813165.400294:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00100000:3.0:1788813165.412329:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813165.412707:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307984512 00000100:00100000:1.0:1788813165.412738:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307984512 00000100:00100000:1.0:1788813165.412858:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:1.0:1788813165.412871:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+32:10504:x1875706307984512:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:1.0:1788813165.413242:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+33:10504:x1875706307984512:12345-192.168.203.13@tcp:35:cat.0 Request processed in 372us (926us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788813165.413251:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:1.0:1788813165.451629:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813165.451890:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307984768 00000100:00100000:3.0:1788813165.451922:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307984768 00000100:00100000:3.0:1788813165.452013:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 95 00000100:00100000:3.0:1788813165.452026:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3c6ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+33:10505:x1875706307984768:12345-192.168.203.13@tcp:36:rm.0 00010000:00010000:3.0:1788813165.452111:0:8565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788813165.452145:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec8b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b80 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.452182:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ec88b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b79 expref: 32 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.452196:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ec853 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b6b expref: 31 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.452208:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef10b7ab00) 00010000:00010000:3.0:1788813165.452221:0:8565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813165.452246:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec8c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.452262:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec8c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.452274:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec8c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.452290:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec8ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.452297:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec8ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.452305:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec8ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.452648:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec8d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.452657:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec8d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.452666:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec8d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788813165.453380:0:8565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1788813165.453393:0:8565:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 325839610224ns, next at 326839607416ns, rc = 0 00010000:00010000:3.0:1788813165.453466:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec8d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.453477:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec8d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.453487:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec8d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.453495:0:8565:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec8d8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.453515:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec8d8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.453522:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec8d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.453550:0:8565:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813165.453575:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec8d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.453589:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec8d1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.453596:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec8d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.453603:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813165.453608:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec8d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.453617:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec8d1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.453630:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef077b4b00) 00010000:00010000:3.0:1788813165.453633:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788813165.453638:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec8d1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.453644:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ec8d1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.453670:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec8c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.453676:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec8c3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.453683:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec8c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.453688:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813165.453698:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec8c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.453704:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec8c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.453712:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:3.0:1788813165.453715:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813165.453717:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec8c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.453723:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ec8c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813165.453735:0:8565:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007562884f reply state 0000000062921d71 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec8ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813165.453745:0:8565:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788813165.453901:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3c6ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+32:10505:x1875706307984768:12345-192.168.203.13@tcp:36:rm.0 Request processed in 1874us (2284us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788813165.453912:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 95 00010000:00010000:2.0:1788813165.454723:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813165.454733:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec8d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.454741:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef421e9c00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:2.0:1788813165.454745:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec8d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.454752:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec8d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.454764:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93ef077b4b00) 00010000:00010000:2.0:1788813165.454766:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788813165.454769:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec8d8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.454775:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec8d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.454831:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813165.454833:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813165.454835:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813165.467155:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec8ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.467177:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec8ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.467186:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec8ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.467193:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813165.467217:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec8ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.467226:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec8ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.467245:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ef077b4a00) 00010000:00010000:2.0:1788813165.467249:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813165.467255:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec8ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.467261:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ec8ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813165.515271:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813165.520155:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307985024 00000100:00100000:0.0:1788813165.520244:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307985024 00000100:00100000:0.0:1788813165.520415:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 96 00000100:00100000:0.0:1788813165.520439:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3c6edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+31:10511:x1875706307985024:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788813165.520474:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813165.520510:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec8df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2b87 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.522218:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec8e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.522245:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec8e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.522260:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec8e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.522278:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec8ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.522284:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec8ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.522291:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec8ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788813165.524589:0:7630:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788813165.525647:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ec8f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.525671:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ec8f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.525685:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ec8f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.525733:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec8e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.525761:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec8e6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.525769:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec8e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.525776:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cfe00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813165.525806:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec8e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.525816:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec8e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.525831:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:0.0:1788813165.525834:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813165.525839:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec8e6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.525846:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ec8e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813165.525866:0:7630:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3f9f9eb reply state 00000000b310e498 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec8ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813165.525876:0:7630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788813165.526242:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec8df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b87 expref: 34 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.526262:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ec8f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b87 expref: 33 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.526285:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef1a079b00) 00010000:00010000:0.0:1788813165.526288:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813165.526291:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cfa00, rc 0) 00000100:00100000:0.0:1788813165.526457:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3c6edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+34:10511:x1875706307985024:12345-192.168.203.13@tcp:101:bash.0 Request processed in 6029us (11202us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788813165.526466:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 96 00010000:00010000:1.0:1788813165.533351:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813165.534418:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec8ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.534435:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec8ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.534443:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec8ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.534450:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190ce200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813165.534455:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec8ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.534478:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec8ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.534495:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ef1a079d00) 00010000:00010000:3.0:1788813165.534510:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813165.534516:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec8ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.534523:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec8ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813165.537217:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813165.537435:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307985152 00000100:00100000:2.0:1788813165.537453:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307985152 00000100:00100000:2.0:1788813165.537578:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:2.0:1788813165.537592:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3c6efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+5:2366:x1875706307985152:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1788813165.537616:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813165.537645:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000124a2e35/0x1b294f297b1ec902 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2b8e expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788813165.537678:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813165.537705:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=325s v=(0 0) 00010000:00010000:2.0:1788813165.537710:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813165.537720:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000124a2e35/0x1b294f297b1ec902 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b8e expref: 6 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.537743:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000124a2e35/0x1b294f297b1ec902 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b8e expref: 6 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.537809:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619e00, rc 0) 00000100:00100000:2.0:1788813165.537891:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3c6efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+6:2366:x1875706307985152:12345-192.168.203.13@tcp:101:bash.0 Request processed in 303us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813165.537899:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00080000:0.0:1788813165.538988:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813165.545149:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813165.545263:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307985280 00000100:00100000:3.0:1788813165.545272:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307985280 00000100:00100000:3.0:1788813165.545331:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:3.0:1788813165.545340:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+6:10511:x1875706307985280:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1788813165.545357:0:8122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813165.545374:0:8122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2e09325/0x1b294f297b1ec909 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2b95 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.545402:0:8122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000124a2e35/0x1b294f297b1ec902 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b8e expref: 7 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.545411:0:8122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813165.545416:0:8122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813165.545421:0:8122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e09325/0x1b294f297b1ec909 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b95 expref: 7 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.545449:0:8122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000124a2e35/0x1b294f297b1ec902 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b8e expref: 7 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.545475:0:8122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000124a2e35/0x1b294f297b1ec902 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b8e expref: 7 pid: 6676 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813165.545488:0:8122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8122:1875706322681344:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788813165.545612:0:8122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef113a90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813165.549211:0:8122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8122:1875706322681344:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788813165.549245:0:8122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c2e09325/0x1b294f297b1ec909 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b95 expref: 7 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.549262:0:8122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef421e9e00, rc 0) 00000100:00100000:3.0:1788813165.549316:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+7:10511:x1875706307985280:12345-192.168.203.13@tcp:101:bash.0 Request processed in 3977us (4175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813165.549325:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:0.0:1788813165.550593:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813165.550703:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307985408 00000100:00100000:3.0:1788813165.550711:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307985408 00010000:00010000:3.0:1788813165.550760:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000124a2e35/0x1b294f297b1ec902 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b8e expref: 7 pid: 6676 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813165.550885:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:0.0:1788813165.550897:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef121e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+7:2365:x1875706307985408:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813165.550930:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813165.550959:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000124a2e35/0x1b294f297b1ec902 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b8e expref: 7 pid: 6676 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.550973:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000124a2e35/0x1b294f297b1ec902 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b8e expref: 7 pid: 6676 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.550995:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000124a2e35/0x1b294f297b1ec902 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b8e expref: 7 pid: 6676 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.551010:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813165.551015:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813165.551022:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2e09325/0x1b294f297b1ec909 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b95 expref: 6 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.551045:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e09325/0x1b294f297b1ec909 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b95 expref: 6 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.551080:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c2e09325/0x1b294f297b1ec909 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b95 expref: 6 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813165.551094:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36adc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5819:1875706322681472:192.168.203.13@tcp:105: 00000100:00100000:0.0:1788813165.551169:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2259aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813165.555230:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36adc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5819:1875706322681472:192.168.203.13@tcp:105: 00010000:00010000:3.0:1788813165.555257:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813165.555316:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef121e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+6:2365:x1875706307985408:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 4422us (4729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813165.555328:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:2.0:1788813165.556487:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813165.557305:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307985664 00000100:00100000:1.0:1788813165.557316:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307985664 00000100:00100000:1.0:1788813165.557411:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:1.0:1788813165.557420:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+33:10511:x1875706307985664:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:1.0:1788813165.557840:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+34:10511:x1875706307985664:12345-192.168.203.13@tcp:35:bash.0 Request processed in 420us (1357us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1788813165.557849:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:0.0:1788813165.748958:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813165.749056:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307985792 00000100:00100000:2.0:1788813165.749066:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307985792 00000100:00100000:2.0:1788813165.749124:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:2.0:1788813165.749135:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+34:10527:x1875706307985792:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813165.749157:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813165.749178:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ec910 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2b9c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.749239:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ec917 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.749253:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ec917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.749268:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ec917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813165.749302:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788813165.749305:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788813165.749323:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ec917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.749346:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ec910 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b9c expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.749379:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ec917 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b9c expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.749388:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:2.0:1788813165.749391:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813165.749394:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21618000, rc 0) 00000100:00100000:2.0:1788813165.749588:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+35:10527:x1875706307985792:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 454us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813165.749595:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:0.0:1788813165.766463:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813165.766865:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307986048 00000100:00100000:3.0:1788813165.766875:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307986048 00000100:00100000:3.0:1788813165.766933:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:3.0:1788813165.766954:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+35:10527:x1875706307986048:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813165.766973:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813165.766993:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec91e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2ba3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.767090:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec925 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.767103:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.767116:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813165.767128:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788813165.767253:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec91e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ba3 expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.767273:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec925 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ba3 expref: 37 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.767281:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef1a079b00) 00010000:00010000:3.0:1788813165.767284:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813165.767288:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef421e9c00, rc 0) 00000100:00100000:3.0:1788813165.767352:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+37:10527:x1875706307986048:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 409us (907us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788813165.767386:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:0.0:1788813165.774153:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813165.774207:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813165.774294:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307986304 00000100:00100000:2.0:1788813165.774304:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307986304 00000100:00100000:2.0:1788813165.774367:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:2.0:1788813165.774377:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+37:10527:x1875706307986304:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813165.774401:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813165.774426:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ec933 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2baa expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.774547:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ec93a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.774566:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ec93a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.774576:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ec93a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813165.774589:0:7630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788813165.774755:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ec933 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2baa expref: 40 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.774830:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ec93a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2baa expref: 39 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.774844:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef1a079b00) 00010000:00010000:2.0:1788813165.774849:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788813165.774853:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619a00, rc 0) 00000100:00100000:2.0:1788813165.774921:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+39:10527:x1875706307986304:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 545us (777us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788813165.774929:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:1.0:1788813165.776271:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307986432 00000100:00100000:1.0:1788813165.776284:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307986432 00000100:00100000:1.0:1788813165.776350:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:1.0:1788813165.776369:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36adea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+39:2364:x1875706307986432:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813165.776383:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813165.776404:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ec925 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ba3 expref: 39 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.776421:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef1a079b00) 00010000:00010000:1.0:1788813165.776436:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813165.776491:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36adea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+38:2364:x1875706307986432:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 132us (2283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813165.776507:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:0.0:1788813165.779507:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813165.779583:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307986560 00000100:00100000:2.0:1788813165.779600:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307986560 00000100:00100000:2.0:1788813165.779655:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:2.0:1788813165.779665:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+6:2366:x1875706307986560:12345-192.168.203.13@tcp:1:lfs.0 00010000:00010000:2.0:1788813165.779710:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000124a2e35/0x1b294f297b1ec948 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.779731:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2e09325/0x1b294f297b1ec909 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b95 expref: 6 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.779739:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788813165.779744:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813165.779748:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000124a2e35/0x1b294f297b1ec948 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.779807:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c2e09325/0x1b294f297b1ec909 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b95 expref: 6 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.779836:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c2e09325/0x1b294f297b1ec909 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b95 expref: 6 pid: 8122 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813165.779852:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36458000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6676:1875706322681600:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788813165.779949:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e11c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788813165.787098:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813165.787254:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36458000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6676:1875706322681600:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788813165.787281:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000124a2e35/0x1b294f297b1ec948 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813165.787472:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307986688 00000100:00100000:1.0:1788813165.787480:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307986688 00002000:00100000:1.0:1788813165.787532:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff93ef36add180 x1875706307986688/t0(0) o4->9c560788-da9a-41fd-952d-091d96dace11@192.168.203.13@tcp:736/0 lens 504/0 e 0 to 0 dl 1788813176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788813165.787542:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93ef36add180 with x1875706307986688 ext(0->8) 00010000:00010000:1.0:1788813165.787550:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c2e09325/0x1b294f297b1ec909 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b95 expref: 7 pid: 8122 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.787563:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c2e09325/0x1b294f297b1ec909 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b95 expref: 7 pid: 8122 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788813165.787571:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93ef36add180 00000100:00100000:1.0:1788813165.787604:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:1.0:1788813165.787614:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9c560788-da9a-41fd-952d-091d96dace11+7:2365:x1875706307986688:12345-192.168.203.13@tcp:4:lfs.0 00000100:00100000:1.0:1788813165.788127:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9c560788-da9a-41fd-952d-091d96dace11+9:2365:x1875706307986688:12345-192.168.203.13@tcp:4:lfs.0 Request processed in 512us (1036us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788813165.788135:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00002000:00100000:1.0:1788813165.788142:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff93ef36add180 x1875706307986688/t4294967302(0) o4->9c560788-da9a-41fd-952d-091d96dace11@192.168.203.13@tcp:736/0 lens 504/448 e 0 to 0 dl 1788813176 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788813165.788149:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93ef36add180 with x1875706307986688 ext(0->8) 00010000:00010000:1.0:1788813165.788154:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c2e09325/0x1b294f297b1ec909 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b95 expref: 9 pid: 8122 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.788172:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c2e09325/0x1b294f297b1ec909 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b95 expref: 9 pid: 8122 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788813165.788179:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93ef36add180 00000100:00100000:0.0:1788813165.791916:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813165.792018:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307986816 00000100:00100000:2.0:1788813165.792028:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307986816 00010000:00010000:2.0:1788813165.792068:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e09325/0x1b294f297b1ec909 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b95 expref: 9 pid: 8122 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813165.792112:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:2.0:1788813165.792121:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36adf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+9:2366:x1875706307986816:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813165.792136:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788813165.792154:0:5820:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788813165.792157:0:5820:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788813165 00002000:00010000:2.0:1788813165.792160:0:5820:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788813165 00002000:00010000:2.0:1788813165.792162:0:5820:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788813165 00010000:00010000:2.0:1788813165.792168:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c2e09325/0x1b294f297b1ec909 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b95 expref: 9 pid: 8122 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.792202:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c2e09325/0x1b294f297b1ec909 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b95 expref: 9 pid: 8122 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.792227:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2e09325/0x1b294f297b1ec909 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b95 expref: 9 pid: 8122 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.792245:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813165.792250:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813165.792256:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000124a2e35/0x1b294f297b1ec948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.792266:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000124a2e35/0x1b294f297b1ec948 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.792300:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813165.792356:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36adf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+8:2366:x1875706307986816:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 235us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813165.792363:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00010000:00010000:1.0:1788813165.792441:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000124a2e35/0x1b294f297b1ec948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.792451:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000124a2e35/0x1b294f297b1ec948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.792474:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000124a2e35/0x1b294f297b1ec948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.792482:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000124a2e35/0x1b294f297b1ec948 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.792490:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000124a2e35/0x1b294f297b1ec948 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.792507:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619e00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:1.0:1788813165.792511:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000124a2e35/0x1b294f297b1ec948 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.792521:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000124a2e35/0x1b294f297b1ec948 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.792544:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000124a2e35/0x1b294f297b1ec948 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.792552:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000124a2e35/0x1b294f297b1ec948 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813165.792599:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+7:2366:x1875706307986560:12345-192.168.203.13@tcp:1:lfs.0 Request processed in 12934us (13118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813165.792606:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:0.0:1788813165.798896:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813165.799077:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307987072 00000100:00100000:2.0:1788813165.799087:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307987072 00000100:00100000:2.0:1788813165.799136:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:2.0:1788813165.799144:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef0e7f9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+38:10527:x1875706307987072:12345-192.168.203.13@tcp:35:lfs.0 00000004:00010000:2.0:1788813165.799200:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ec93a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2baa expref: 38 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788813165.799452:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1788813165.799506:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1788813165.799816:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1788813165.799866:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec94f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.799882:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ec8f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b87 expref: 42 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.800411:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec94f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.800450:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ec8f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b87 expref: 42 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.800465:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ec8f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b87 expref: 42 pid: 7630 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813165.800491:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36458000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5837:1875706322681728:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788813165.800588:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e11c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788813165.805705:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36458000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5837:1875706322681728:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788813165.805735:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec94f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813165.806541:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813165.808726:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307987200 00000100:00100000:3.0:1788813165.808743:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307987200 00010000:00010000:3.0:1788813165.808837:0:8439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ec8f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b87 expref: 43 pid: 7630 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813165.809624:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:1.0:1788813165.809640:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36adc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+43:2365:x1875706307987200:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813165.809656:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813165.809664:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ec8f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b87 expref: 43 pid: 7630 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.809677:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ec8f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b87 expref: 43 pid: 7630 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.809698:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ec8f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b87 expref: 43 pid: 7630 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.809715:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef1a079b00) 00010000:00010000:1.0:1788813165.809720:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec94f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.809744:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec94f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.809753:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec94f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813165.809827:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813165.809886:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36adc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+42:2365:x1875706307987200:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 252us (3348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813165.809893:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00010000:00010000:2.0:1788813165.809982:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec94f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.809990:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec94f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788813165.810118:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788813165.810307:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1788813165.810419:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36458000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1875706322681856:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788813165.810477:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813165.810525:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e11c000 going to sleep for 11 seconds 00000100:00100000:1.0:1788813165.811671:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322681856 00000100:00100000:1.0:1788813165.811682:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322681856 00000100:00100000:1.0:1788813165.811751:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813165.811761:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5837:x1875706322681856:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788813165.811897:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5837:x1875706322681856:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 137us (1419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813165.811904:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788813165.812006:0:5837:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1788813165.812013:0:5837:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:2.0:1788813165.812031:0:5837:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ef35a1f100, transno 4294967301 00000100:00100000:2.0:1788813165.812052:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36458000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1875706322681856:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788813165.812512:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1788813165.812588:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36176680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1875706322681984:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788813165.812627:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813165.812648:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e11c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788813165.812959:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322681984 00000100:00100000:1.0:1788813165.812966:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322681984 00000100:00100000:1.0:1788813165.813008:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813165.813017:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5837:x1875706322681984:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788813165.813181:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5837:x1875706322681984:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 165us (553us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788813165.813189:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788813165.813336:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813165.813432:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36176680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1875706322681984:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788813165.813486:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1788813165.813535:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec94f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.813547:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec94f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.813555:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec94f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.813560:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813165.813565:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec94f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.813591:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec94f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.813607:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef1a079b00) 00010000:00010000:2.0:1788813165.813610:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788813165.813616:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec94f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.813622:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec94f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788813165.813812:0:5837:0:(mdd_object.c:4199:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788813165.813890:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1788813165.813900:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 326200118073ns, next at 327200116085ns, rc = 0 00000001:00080000:2.0:1788813165.813906:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788813165.813934:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef1a079b00) 00010000:00010000:2.0:1788813165.814056:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788813165.814065:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ec93a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2baa expref: 46 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813165.814210:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef0e7f9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+45:10527:x1875706307987072:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 15065us (15328us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1788813165.814219:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000020:00080000:2.0:1788813165.814223:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788813165.835748:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813165.835848:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307987328 00000100:00100000:3.0:1788813165.835866:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307987328 00000100:00100000:2.0:1788813165.836006:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:2.0:1788813165.836019:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+45:10527:x1875706307987328:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813165.836042:0:8565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813165.836081:0:8565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ec956 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2bb1 expref: -99 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.836137:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ec956 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bb1 expref: 46 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.836150:0:8565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ec956 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bb1 expref: 46 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.836166:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:2.0:1788813165.836169:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788813165.836172:0:8565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619a00, rc 0) 00000100:00100000:2.0:1788813165.836234:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+46:10527:x1875706307987328:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 217us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813165.836240:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:0.0:1788813165.838447:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813165.838564:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307987584 00000100:00100000:1.0:1788813165.838575:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307987584 00000100:00100000:1.0:1788813165.838628:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:1.0:1788813165.838651:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+46:10527:x1875706307987584:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1788813165.838922:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+47:10527:x1875706307987584:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 273us (483us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1788813165.838930:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:1.0:1788813165.930585:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813165.930950:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307987712 00000100:00100000:0.0:1788813165.930970:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307987712 00000100:00100000:0.0:1788813165.931031:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00100000:0.0:1788813165.931041:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3c6eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+47:10537:x1875706307987712:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:0.0:1788813165.931121:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec95d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931151:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec95d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931162:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec95d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931179:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec964 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931184:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931190:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931286:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec96b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931295:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec96b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931302:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec96b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813165.931341:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec96b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931353:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec95d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931360:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec95d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931377:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec95d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931384:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190ce200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813165.931388:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec95d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931396:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec95d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931419:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:0.0:1788813165.931422:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813165.931427:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec95d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931434:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec95d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931449:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931455:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec964 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931461:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931466:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190ce800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813165.931469:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931485:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec964 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931502:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ef1a079e00) 00010000:00010000:0.0:1788813165.931505:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813165.931508:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec964 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931514:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec964 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931529:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec96b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931537:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec96b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931544:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec96b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931550:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cee00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813165.931553:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec96b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931558:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec96b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931565:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:0.0:1788813165.931568:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813165.931570:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec96b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813165.931586:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ec96b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813165.931667:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3c6eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+47:10537:x1875706307987712:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 626us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813165.931676:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00100000:0.0:1788813165.977738:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813165.977888:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307987968 00000100:00100000:2.0:1788813165.977898:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307987968 00000100:00100000:2.0:1788813165.977961:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 102 00000100:00100000:2.0:1788813165.977970:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+47:10540:x1875706307987968:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813165.977991:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813165.978010:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec972 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2bb8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.978156:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ec979 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.978171:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ec979 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.978200:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ec979 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.978215:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ec980 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.978222:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ec980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.978228:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ec980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.978333:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec987 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.978340:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec987 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.978347:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec987 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813165.978355:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788813165.978444:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ec979 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.978451:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ec979 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.978458:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ec979 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.978464:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813165.978474:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ec979 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.978481:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ec979 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.978506:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:2.0:1788813165.978510:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813165.978515:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ec979 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.978522:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ec979 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.978536:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ec980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.978543:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ec980 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.978549:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ec980 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.978554:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618a00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813165.978557:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ec980 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.978562:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ec980 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.978569:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ef10b7a000) 00010000:00010000:2.0:1788813165.978572:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813165.978581:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ec980 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.978587:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ec980 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.978627:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ec972 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bb8 expref: 50 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.978641:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec987 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bb8 expref: 49 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813165.978649:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:2.0:1788813165.978651:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813165.978654:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619c00, rc 0) 00000100:00100000:2.0:1788813165.979950:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+49:10540:x1875706307987968:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1973us (2214us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788813165.979960:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 102 00000100:00100000:1.0:1788813165.986225:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813165.986356:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307988096 00000100:00100000:3.0:1788813165.986374:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307988096 00000100:00100000:3.0:1788813165.986459:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 103 00000100:00100000:3.0:1788813165.986472:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3c6ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+49:10540:x1875706307988096:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:3.0:1788813165.986578:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec995 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.986601:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.986615:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.986649:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.986657:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec995 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.986666:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec995 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.986672:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef421e8c00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813165.986695:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec995 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.986705:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec995 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.986719:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:3.0:1788813165.986723:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813165.986729:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec995 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813165.986737:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec995 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813165.986995:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3c6ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+49:10540:x1875706307988096:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 523us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813165.987007:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 103 00000100:00100000:0.0:1788813165.990779:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813165.991532:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307988352 00000100:00100000:2.0:1788813165.991545:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307988352 00000100:00100000:2.0:1788813165.991610:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:2.0:1788813165.991620:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef363d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+49:10540:x1875706307988352:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788813165.991891:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef363d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+50:10540:x1875706307988352:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 271us (1119us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788813165.991899:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:2.0:1788813166.067936:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813166.068079:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307988608 00000100:00100000:0.0:1788813166.068093:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307988608 00000100:00100000:0.0:1788813166.068304:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 104 00000100:00100000:0.0:1788813166.068317:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+50:10550:x1875706307988608:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788813166.068342:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813166.068345:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788813166.068373:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ec917 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b9c expref: 50 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.068396:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:0.0:1788813166.068401:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813166.068415:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec99c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2bbf expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.068524:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec9a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.068539:0:7630:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec987 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bb8 expref: 50 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.068569:0:7630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec9a3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.068606:0:7630:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec987 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bb8 expref: 50 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.068619:0:7630:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec987 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bb8 expref: 50 pid: 5834 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813166.068632:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef363d6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7630:1875706322682112:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788813166.068728:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2259aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813166.070675:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef363d6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7630:1875706322682112:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788813166.070703:0:7630:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec9a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788813166.072668:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813166.078971:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813166.079172:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307988736 00000100:00100000:0.0:1788813166.079183:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307988736 00010000:00010000:0.0:1788813166.079225:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec987 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bb8 expref: 51 pid: 5834 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813166.079264:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:0.0:1788813166.079275:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36458000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+51:2366:x1875706307988736:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813166.079289:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813166.079296:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec987 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bb8 expref: 51 pid: 5834 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.079310:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec987 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bb8 expref: 51 pid: 5834 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.079333:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ec987 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bb8 expref: 51 pid: 5834 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.079355:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:0.0:1788813166.079360:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec9a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.079370:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec9a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.079378:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec9a3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.079410:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813166.079463:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36458000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+50:2366:x1875706307988736:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 190us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813166.079471:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00010000:00010000:1.0:1788813166.079812:0:7630:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec9a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.079822:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec9a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813166.079980:0:7630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788813166.080325:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ec99c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bbf expref: 51 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.080345:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec9a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bbf expref: 50 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.080353:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:0.0:1788813166.080356:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788813166.080359:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190ce200, rc 0) 00000100:00100000:0.0:1788813166.080409:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+50:10550:x1875706307988608:12345-192.168.203.13@tcp:101:bash.0 Request processed in 12096us (12489us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788813166.080417:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 104 00000100:00100000:2.0:1788813166.084027:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813166.084373:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307988992 00000100:00100000:0.0:1788813166.084394:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307988992 00000100:00100000:0.0:1788813166.084454:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 105 00000100:00100000:0.0:1788813166.084463:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+50:10550:x1875706307988992:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:0.0:1788813166.084719:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ec9b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.084840:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ec9b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.084854:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ec9b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788813166.084908:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1788813166.084935:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b990ac0c reply state 00000000b69d5e9f transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ec9b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813166.084944:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788813166.085034:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+53:10550:x1875706307988992:12345-192.168.203.13@tcp:36:bash.0 Request processed in 571us (1015us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788813166.085041:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 105 00000020:00080000:0.0:1788813166.085046:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788813166.090885:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813166.091624:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307989120 00000100:00100000:3.0:1788813166.091636:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307989120 00010000:00010000:2.0:1788813166.091644:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ec9b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.091655:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ec9b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.091662:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ec9b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.091668:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cf000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813166.091673:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ec9b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.091680:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ec9b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.091696:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:2.0:1788813166.091699:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788813166.091703:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 106 00010000:00010000:2.0:1788813166.091704:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ec9b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.091710:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ec9b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813166.091713:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef363d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+53:10550:x1875706307989120:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1788813166.091734:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813166.091751:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec9b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2bc6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.092345:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec9bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.092363:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec9a3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bbf expref: 53 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.092386:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec9bf lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.092418:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec9a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bbf expref: 53 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.092433:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec9a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bbf expref: 53 pid: 7630 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813166.092447:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875706322682240:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788813166.092643:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef113a9540 going to sleep for 11 seconds 00000100:00100000:1.0:1788813166.097955:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813166.098160:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307989248 00000100:00100000:2.0:1788813166.098169:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307989248 00010000:00010000:2.0:1788813166.098210:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec9a3 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bbf expref: 54 pid: 7630 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813166.098245:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:2.0:1788813166.098254:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3c6edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+54:2366:x1875706307989248:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813166.098283:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813166.098291:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec9a3 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bbf expref: 54 pid: 7630 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.098304:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec9a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bbf expref: 54 pid: 7630 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.098327:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:2.0:1788813166.098333:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec9bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.098343:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec9bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.098351:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec9bf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.098371:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813166.098418:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3c6edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+54:2366:x1875706307989248:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 165us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813166.098426:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00010000:00010000:3.0:1788813166.100527:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ec9a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bbf expref: 53 pid: 7630 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813166.100550:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875706322682240:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788813166.100572:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec9bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.100583:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec9bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.100657:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec9bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813166.100773:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788813166.100778:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813166.108121:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec9bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.109612:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ec9b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bc6 expref: 53 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.109637:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec9bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bc6 expref: 52 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.109647:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:3.0:1788813166.109650:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813166.109653:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef421e9e00, rc 0) 00000100:00100000:3.0:1788813166.109728:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef363d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+52:10550:x1875706307989120:12345-192.168.203.13@tcp:101:bash.0 Request processed in 18015us (18850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813166.109819:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 106 00000100:00100000:3.0:1788813166.114168:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813166.114252:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307989504 00000100:00100000:2.0:1788813166.114263:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307989504 00000100:00100000:2.0:1788813166.114321:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:2.0:1788813166.114332:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+52:10550:x1875706307989504:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:2.0:1788813166.114565:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+53:10550:x1875706307989504:12345-192.168.203.13@tcp:35:bash.0 Request processed in 233us (404us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788813166.114572:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:2.0:1788813166.217136:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813166.217307:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307989632 00000100:00100000:0.0:1788813166.217319:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307989632 00000100:00100000:0.0:1788813166.217384:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 107 00000100:00100000:0.0:1788813166.217394:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+53:10556:x1875706307989632:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813166.217416:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813166.217436:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec9c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2bcd expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.217532:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec9cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.217547:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec9cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.217557:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec9cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813166.217589:0:7630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788813166.217593:0:7630:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788813166.217609:0:7630:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec9cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.217634:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec9c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bcd expref: 55 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.217653:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec9cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bcd expref: 54 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.217662:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:0.0:1788813166.217664:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788813166.217668:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cfc00, rc 0) 00000100:00100000:0.0:1788813166.217737:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+54:10556:x1875706307989632:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 343us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813166.217753:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 107 00000100:00100000:2.0:1788813166.225596:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813166.225696:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307989760 00000100:00100000:0.0:1788813166.225707:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307989760 00000100:00100000:0.0:1788813166.225809:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:0.0:1788813166.225818:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+54:10556:x1875706307989760:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813166.225836:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813166.225855:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec9d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2bd4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.225917:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec9db lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.225932:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec9db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.225943:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec9db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.225957:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ec9e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.225964:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ec9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.225971:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ec9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.226083:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1ec9e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.226092:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1ec9e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.226099:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1ec9e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813166.226140:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788813166.226144:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788813166.226162:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1ec9e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.226173:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1ec9e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.226181:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec9db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.226188:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec9db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.226194:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec9db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.226200:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cf400 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813166.226205:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec9db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.226212:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec9db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.226223:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:0.0:1788813166.226226:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813166.226231:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec9db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.226238:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1ec9db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.226264:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ec9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.226270:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ec9e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.226277:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ec9e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.226282:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190ce600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813166.226285:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ec9e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.226291:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ec9e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.226299:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ef1a079e00) 00010000:00010000:0.0:1788813166.226301:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813166.226304:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ec9e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.226310:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ec9e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.226339:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1ec9d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bd4 expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.226352:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1ec9e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bd4 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.226369:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:0.0:1788813166.226371:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813166.226374:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cf200, rc 0) 00000100:00100000:0.0:1788813166.226440:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+55:10556:x1875706307989760:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 622us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813166.226448:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:0.0:1788813166.237035:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322682368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813166.237119:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813166.237623:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322682368 00000100:00100000:1.0:1788813166.237632:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322682368 00000100:00100000:1.0:1788813166.237681:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788813166.237690:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef363d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875706322682368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788813166.237713:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813166.237884:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813166.237909:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322682624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813166.237953:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813166.237986:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322682624 00000100:00100000:2.0:1788813166.237990:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322682624 00000100:00100000:2.0:1788813166.238020:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788813166.238028:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875706322682624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813166.238050:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813166.238095:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875706322682624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813166.238101:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788813166.238147:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322682624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813166.238187:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322682496:0@lo:400:kworker.0 00000100:00100000:2.0:1788813166.238215:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813166.238250:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322682496 00000100:00100000:2.0:1788813166.238254:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322682496 00000100:00100000:2.0:1788813166.238282:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788813166.238288:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3302:x1875706322682496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813166.238323:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3302:x1875706322682496:12345-0@lo:400:kworker.0 Request processed in 35us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813166.238329:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788813166.238362:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322682496:0@lo:400:kworker.0 00000100:00080000:2.0:1788813166.238393:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813166.240940:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef363d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875706322682368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3241us (3810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813166.241165:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788813166.242295:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875706322682752:0@lo:400:kworker.0 00000100:00100000:2.0:1788813166.242373:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813166.242475:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1875706322683008:0@lo:400:kworker.0 00000100:00100000:3.0:1788813166.242519:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813166.242542:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788813166.242548:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1875706322682880:0@lo:400:kworker.0 00000100:00100000:3.0:1788813166.242569:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813166.242595:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322682752 00000100:00100000:3.0:1788813166.242602:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322682752 00000100:00100000:3.0:1788813166.242640:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322683008 00000100:00100000:3.0:1788813166.242643:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322683008 00000100:00100000:3.0:1788813166.242671:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322682880 00000100:00100000:3.0:1788813166.242673:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322682880 00000100:00100000:3.0:1788813166.242691:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788813166.242698:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875706322682752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813166.242842:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813166.242865:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813166.242916:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307990016 00000100:00100000:1.0:1788813166.242920:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307990016 00000100:00100000:1.0:1788813166.243186:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788813166.243195:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875706322683008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813166.243242:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875706322683008:12345-0@lo:400:kworker.0 Request processed in 48us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813166.243249:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788813166.243266:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788813166.243272:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875706322682880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813166.243297:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875706322682880:12345-0@lo:400:kworker.0 Request processed in 27us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813166.243303:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788813166.243315:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 109 00000100:00100000:1.0:1788813166.243322:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3c6ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+55:10556:x1875706307990016:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813166.243335:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813166.243358:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ec9f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2bdb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.243454:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ec9f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.243469:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec9bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bc6 expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.243477:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1ec9e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bd4 expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.243512:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ec9f7 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.243540:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1ec9e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bd4 expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.243554:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1ec9e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bd4 expref: 56 pid: 5834 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813166.243566:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3c6ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1875706322683136:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788813166.243642:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec9bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bc6 expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.243653:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec9bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bc6 expref: 56 pid: 5836 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813166.243661:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3c6ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1875706322683264:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788813166.243684:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a1f4180 going to sleep for 11 seconds 00000100:00100000:1.0:1788813166.243716:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307990144 00000100:00100000:1.0:1788813166.243721:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307990144 00010000:00010000:1.0:1788813166.243741:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1ec9e9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bd4 expref: 57 pid: 5834 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813166.243766:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:1.0:1788813166.243774:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3c6ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+57:2366:x1875706307990144:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813166.243830:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813166.243837:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1ec9e9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bd4 expref: 57 pid: 5834 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.243848:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1ec9e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bd4 expref: 57 pid: 5834 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.243865:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:1.0:1788813166.243869:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ec9f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.243876:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ec9f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.243882:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813166.245829:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322682368:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788813166.246128:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813166.246186:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1875706322682880:0@lo:400:kworker.0 00000100:00100000:0.0:1788813166.246201:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1875706322683008:0@lo:400:kworker.0 00000100:00100000:2.0:1788813166.246482:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875706322682752:0@lo:400:kworker.0 00000100:00100000:1.0:1788813166.246559:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3c6ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+57:2366:x1875706307990144:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 2780us (3687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813166.246570:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:3.0:1788813166.250286:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875706322682752:12345-0@lo:400:kworker.0 Request processed in 7579us (7905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813166.250312:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788813166.250650:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813166.251546:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307990272 00000100:00100000:0.0:1788813166.251558:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307990272 00010000:00010000:0.0:1788813166.251604:0:8439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec9bf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bc6 expref: 57 pid: 5836 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813166.251647:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:0.0:1788813166.251657:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef121e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+57:2366:x1875706307990272:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813166.251672:0:8439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813166.251679:0:8439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec9bf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bc6 expref: 57 pid: 5836 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.251709:0:8439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec9bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bc6 expref: 57 pid: 5836 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.251732:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:0.0:1788813166.251737:0:8439:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ec9f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.251746:0:8439:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ec9f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.251754:0:8439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ec9f7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.251772:0:8439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813166.251849:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef121e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+57:2366:x1875706307990272:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 193us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813166.251857:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00010000:00010000:1.0:1788813166.252751:0:5834:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.13@tcp) returned -22 from blocking AST (req@00000000e0687bcc x1875706322683136) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1ec9e9 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bd4 expref: 56 pid: 5834 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.252769:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1ec9e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bd4 expref: 56 pid: 5834 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813166.257178:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3c6ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1875706322683136:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788813166.257229:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ec9bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bc6 expref: 55 pid: 5836 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813166.257274:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3c6ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1875706322683264:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788813166.257298:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:1.0:1788813166.257306:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ec9f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.257315:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ec9f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.257322:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ec9f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813166.257343:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788813166.257484:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ec9f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bdb expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.257512:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ec9f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bdb expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.257520:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:1.0:1788813166.257523:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788813166.257525:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fc000, rc 0) 00000100:00100000:1.0:1788813166.257588:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3c6ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+55:10556:x1875706307990016:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 14265us (14746us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788813166.257597:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 109 00000100:00100000:2.0:1788813166.260564:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813166.260657:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307990528 00000100:00100000:0.0:1788813166.260666:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307990528 00000100:00100000:0.0:1788813166.260729:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:0.0:1788813166.260739:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+55:10556:x1875706307990528:12345-192.168.203.13@tcp:103:lfs.0 00010000:00010000:0.0:1788813166.260754:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813166.260813:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ec956 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bb1 expref: 55 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.260833:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:0.0:1788813166.260838:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813166.260908:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+54:10556:x1875706307990528:12345-192.168.203.13@tcp:103:lfs.0 Request processed in 169us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813166.260915:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:0.0:1788813166.264975:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813166.265091:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307990656 00000100:00100000:3.0:1788813166.265101:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307990656 00000100:00100000:3.0:1788813166.265158:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 110 00000100:00100000:3.0:1788813166.265169:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef363d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+54:10556:x1875706307990656:12345-192.168.203.13@tcp:58:lfs.0 00010000:00010000:3.0:1788813166.265283:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1eca05 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.265300:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1eca05 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.265312:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1eca05 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788813166.265482:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788813166.265573:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef363d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+54:10556:x1875706307990656:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 405us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813166.265581:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 110 00000100:00100000:3.0:1788813166.272082:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813166.272176:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307990784 00000100:00100000:0.0:1788813166.272186:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307990784 00000100:00100000:0.0:1788813166.272243:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 111 00000100:00100000:0.0:1788813166.272254:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+54:10556:x1875706307990784:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813166.272274:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813166.272296:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1eca0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2be2 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.272351:0:7630:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1eca05 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.272363:0:7630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1eca0c lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2be2 expref: 55 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.272382:0:7630:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1eca05 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.272395:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1eca0c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2be2 expref: 55 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.272409:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:0.0:1788813166.272412:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788813166.272416:0:7630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1eca0c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2be2 expref: 55 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.272442:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cf400, rc 0) 00000100:00100000:0.0:1788813166.272512:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+55:10556:x1875706307990784:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 260us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813166.272520:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 111 00010000:00010000:2.0:1788813166.559376:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788813166.813156:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788813166.813166:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788813166.813228:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788813166.813235:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788813166.813361:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368c5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1875706322683392:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788813166.813933:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e11c780 going to sleep for 11 seconds 00000100:00100000:3.0:1788813166.820887:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813166.820981:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307990912 00000100:00100000:0.0:1788813166.820991:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307990912 00000100:00100000:0.0:1788813166.821048:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 112 00000100:00100000:0.0:1788813166.821059:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+56:10558:x1875706307990912:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788813166.821088:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788813166.821193:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+56:10558:x1875706307990912:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 135us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813166.821200:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 112 00000100:00100000:2.0:1788813166.824225:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368c5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1875706322683392:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788813166.826655:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813166.826904:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307991040 00000100:00100000:0.0:1788813166.826914:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307991040 00000100:00100000:0.0:1788813166.826980:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:0.0:1788813166.826991:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3c6ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+55:10558:x1875706307991040:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788813166.827062:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1eca13 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827079:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1eca13 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827092:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1eca13 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827147:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eca1a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827168:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eca1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827176:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eca1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827201:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1eca21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827209:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1eca21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827216:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1eca21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813166.827254:0:8565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788813166.827258:0:8565:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788813166.827271:0:8565:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1eca21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827282:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1eca13 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827288:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1eca13 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827295:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1eca13 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827301:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cf200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813166.827305:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1eca13 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827321:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1eca13 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827333:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ef077b4200) 00010000:00010000:0.0:1788813166.827337:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813166.827342:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1eca13 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827348:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1eca13 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827362:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eca1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827368:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eca1a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827373:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eca1a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827378:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190ce600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813166.827381:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eca1a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827387:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eca1a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827394:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff93ef1a079e00) 00010000:00010000:0.0:1788813166.827397:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813166.827400:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eca1a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827430:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eca1a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827445:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1eca21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827452:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1eca21 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827458:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1eca21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827462:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cf800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813166.827465:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1eca21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827471:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1eca21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827478:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:0.0:1788813166.827481:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813166.827484:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1eca21 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.827499:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1eca21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813166.827575:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3c6ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+55:10558:x1875706307991040:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 585us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813166.827583:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:1.0:1788813166.834181:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813166.834369:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307991296 00000100:00100000:3.0:1788813166.834378:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307991296 00000100:00100000:3.0:1788813166.834435:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:3.0:1788813166.834770:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3c6ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+55:10558:x1875706307991296:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813166.834826:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813166.834846:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1eca28 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2be9 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.835117:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.835131:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.835143:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813166.835157:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788813166.835265:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.835273:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.835280:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.835286:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef421e9e00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813166.835290:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.835297:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.835310:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:3.0:1788813166.835312:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788813166.835318:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.835335:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.835380:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1eca28 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2be9 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.835391:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ef077b4200) 00010000:00010000:3.0:1788813166.835393:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813166.835397:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1eca28 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2be9 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.835405:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef421e9c00, rc 0) 00000100:00100000:3.0:1788813166.835557:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3c6ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+56:10558:x1875706307991296:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1111us (1383us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1788813166.835565:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:3.0:1788813166.840271:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813166.840461:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307991424 00000100:00100000:0.0:1788813166.840472:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307991424 00000100:00100000:0.0:1788813166.840544:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:0.0:1788813166.840554:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+56:10558:x1875706307991424:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788813166.840587:0:5836:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788813166.840712:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+56:10558:x1875706307991424:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 158us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813166.840720:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:1.0:1788813166.854915:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813166.855039:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307991680 00000100:00100000:2.0:1788813166.855049:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307991680 00000100:00100000:2.0:1788813166.855111:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:2.0:1788813166.855121:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3c6ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+56:10558:x1875706307991680:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813166.855140:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813166.855143:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788813166.855169:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ec9cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bcd expref: 56 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.855187:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:2.0:1788813166.855192:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813166.855204:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1eca3d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2bf0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788813166.855686:0:7630:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788813166.855935:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1eca44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.855948:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1eca44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.855960:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1eca44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.856012:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1eca3d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bf0 expref: 58 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.856027:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1eca44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bf0 expref: 57 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.856035:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93ef10b7a000) 00010000:00010000:2.0:1788813166.856037:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813166.856040:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21618a00, rc 0) 00000100:00100000:2.0:1788813166.856259:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3c6ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+57:10558:x1875706307991680:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1138us (1352us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788813166.856268:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:2.0:1788813166.869275:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813166.869352:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307991936 00000100:00100000:3.0:1788813166.869363:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307991936 00000100:00100000:3.0:1788813166.869554:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:3.0:1788813166.869566:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+57:10558:x1875706307991936:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788813166.869634:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813166.869660:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1eca44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bf0 expref: 57 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.869677:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93ef10b7a000) 00010000:00010000:3.0:1788813166.869687:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813166.869725:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1eca52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.869740:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1eca52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.869748:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1eca52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.869842:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xc02dc48c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.869850:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc02dc48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.869857:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc02dc48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.869921:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1eca52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.869929:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1eca52 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.869935:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1eca52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.869941:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef421e9c00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813166.869945:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1eca52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.869952:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1eca52 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.869972:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:3.0:1788813166.869975:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813166.869978:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1eca52 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.869984:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1eca52 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.869995:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc02dc48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.870001:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc02dc48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.870007:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc02dc48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.870012:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef421e9e00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813166.870014:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc02dc48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.870020:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca59 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc02dc48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.870025:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xc02dc48c (ffff93ef077b4800) 00010000:00010000:3.0:1788813166.870027:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813166.870029:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca59 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc02dc48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.870032:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc02dc48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813166.870256:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+56:10558:x1875706307991936:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 691us (988us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788813166.870264:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:1.0:1788813166.880288:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813166.880497:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307992064 00000100:00100000:0.0:1788813166.880508:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307992064 00000100:00100000:0.0:1788813166.880567:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:0.0:1788813166.880587:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3c6ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+56:10558:x1875706307992064:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813166.880607:0:8565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813166.880629:0:8565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1eca60 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2bf7 expref: -99 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.880662:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eca67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.880675:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eca67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.880688:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eca67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.880973:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf800/0x1b294f297b1eca60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bf7 expref: 58 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.880994:0:8565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eca67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bf7 expref: 57 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813166.881011:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93ef1a079e00) 00010000:00010000:0.0:1788813166.881013:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788813166.881016:0:8565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190ce600, rc 0) 00000100:00100000:1.0:1788813166.883386:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3c6ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+57:10558:x1875706307992064:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 2801us (3097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813166.883398:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:1.0:1788813166.896434:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813166.896548:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307992320 00000100:00100000:2.0:1788813166.896558:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307992320 00000100:00100000:2.0:1788813166.896631:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:2.0:1788813166.896641:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3c6ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+57:10558:x1875706307992320:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788813166.896733:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1eca6e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.896749:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1eca6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813166.896762:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1eca6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788813166.897477:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1788813166.897499:0:7630:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 327283717220ns, next at 328283703522ns, rc = 0 00000004:00010000:2.0:1788813166.901409:0:7630:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ad18de4 reply state 00000000a8d742b2 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1eca6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813166.901433:0:7630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788813166.901657:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3c6ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+59:10558:x1875706307992320:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 5013us (5227us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788813166.901668:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 119 00010000:00010000:3.0:1788813166.905498:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1eca6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.905516:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1eca6e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.905523:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1eca6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.905530:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813166.905535:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1eca6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.905542:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1eca6e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.905558:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93ef1a079e00) 00010000:00010000:3.0:1788813166.905561:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788813166.905565:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1eca6e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.905571:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1eca6e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813166.921397:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813166.924249:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307992448 00000100:00100000:3.0:1788813166.924263:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307992448 00000100:00100000:3.0:1788813166.924333:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:3.0:1788813166.924357:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3c6eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+58:10558:x1875706307992448:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813166.924379:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813166.924398:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2bfe expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.924456:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bfe expref: 59 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.924469:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bfe expref: 59 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.924485:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93ef1a079e00) 00010000:00010000:3.0:1788813166.924499:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813166.924503:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef421e9e00, rc 0) 00000100:00100000:3.0:1788813166.924576:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3c6eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+59:10558:x1875706307992448:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 221us (3188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813166.924582:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:2.0:1788813166.927077:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813166.927253:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307992576 00000100:00100000:1.0:1788813166.927267:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307992576 00000100:00100000:1.0:1788813166.927335:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:1.0:1788813166.927346:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+8:2365:x1875706307992576:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788813166.932097:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+9:2365:x1875706307992576:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 4736us (5018us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788813166.932113:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:2.0:1788813166.955172:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813166.959133:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307992832 00000100:00100000:1.0:1788813166.959153:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307992832 00000100:00100000:1.0:1788813166.959308:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:1.0:1788813166.959321:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+59:10558:x1875706307992832:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788813166.959686:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+60:10558:x1875706307992832:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 367us (4527us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788813166.959695:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:0.0:1788813166.972836:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813166.975941:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307993088 00000100:00100000:1.0:1788813166.976885:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307993088 00000100:00100000:1.0:1788813166.977057:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:1.0:1788813166.977071:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef363d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+60:10558:x1875706307993088:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788813166.977238:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef363d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+60:10558:x1875706307993088:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 171us (4417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813166.977264:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:2.0:1788813166.984617:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813166.984715:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307993216 00000100:00100000:3.0:1788813166.984729:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307993216 00000100:00100000:3.0:1788813166.984829:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:3.0:1788813166.984841:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+60:10558:x1875706307993216:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813166.984869:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813166.985140:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1eca7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2c05 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.985239:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1eca83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.985281:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1eca83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.985297:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1eca83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813166.985345:0:7630:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813166.985367:0:7630:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1eca83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.985399:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1eca7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c05 expref: 62 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.985422:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1eca83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c05 expref: 61 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813166.985433:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93ef1a079e00) 00010000:00010000:3.0:1788813166.985436:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788813166.985441:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164f000, rc 0) 00000100:00100000:3.0:1788813166.985564:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+61:10558:x1875706307993216:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 724us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813166.985572:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:2.0:1788813166.993839:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813166.993981:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307993344 00000100:00100000:1.0:1788813166.993996:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307993344 00000100:00100000:1.0:1788813166.994063:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:1.0:1788813166.994075:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+9:2363:x1875706307993344:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813166.994100:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813166.994129:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0cde138/0x1b294f297b1eca8a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2c0c expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788813166.994164:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f1f6e, blocks: 0x1 00010000:00010000:1.0:1788813166.994189:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=327s v=(0 0) 00010000:00010000:1.0:1788813166.994194:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813166.994204:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0cde138/0x1b294f297b1eca8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c0c expref: 10 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.994226:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f0cde138/0x1b294f297b1eca8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c0c expref: 10 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813166.994241:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fde00, rc 0) 00000100:00100000:1.0:1788813166.994316:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+10:2363:x1875706307993344:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 243us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813166.994325:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:0.0:1788813167.002733:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813167.003136:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307993600 00000100:00100000:1.0:1788813167.003152:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307993600 00000100:00100000:1.0:1788813167.003236:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:1.0:1788813167.003249:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef363d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+61:10558:x1875706307993600:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788813167.003415:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef363d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+61:10558:x1875706307993600:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 168us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813167.003424:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:3.0:1788813167.005978:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813167.006145:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307993728 00000100:00100000:2.0:1788813167.006158:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307993728 00000100:00100000:2.0:1788813167.006243:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:2.0:1788813167.006256:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+10:10558:x1875706307993728:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813167.006278:0:8122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813167.006301:0:8122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1eca91 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2c13 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.006361:0:8122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0cde138/0x1b294f297b1eca8a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c0c expref: 11 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.006372:0:8122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813167.006378:0:8122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813167.006384:0:8122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1eca91 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c13 expref: 11 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.006430:0:8122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f0cde138/0x1b294f297b1eca8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c0c expref: 11 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.006446:0:8122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f0cde138/0x1b294f297b1eca8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c0c expref: 11 pid: 6675 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813167.006464:0:8122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8122:1875706322683520:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788813167.006596:0:8122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef211ca300 going to sleep for 11 seconds 00000100:00080000:0.0:1788813167.006822:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813167.009688:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813167.009832:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307993856 00000100:00100000:0.0:1788813167.009845:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307993856 00010000:00010000:0.0:1788813167.009911:0:8439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f0cde138/0x1b294f297b1eca8a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c0c expref: 12 pid: 6675 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813167.010089:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:1.0:1788813167.010103:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+12:2366:x1875706307993856:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813167.010123:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813167.010153:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f0cde138/0x1b294f297b1eca8a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c0c expref: 12 pid: 6675 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.010170:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f0cde138/0x1b294f297b1eca8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c0c expref: 12 pid: 6675 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.010202:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813167.010207:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813167.010219:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1eca91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c13 expref: 12 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.010232:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1eca91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c13 expref: 12 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.010278:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1eca91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c13 expref: 12 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813167.010296:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3c6ef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5818:1875706322683648:192.168.203.13@tcp:105: 00000100:00100000:1.0:1788813167.010401:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a1f4180 going to sleep for 11 seconds 00010000:00010000:2.0:1788813167.010876:0:8122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0cde138/0x1b294f297b1eca8a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c0c expref: 12 pid: 6675 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813167.010906:0:8122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8122:1875706322683520:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788813167.010947:0:8122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1eca91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c13 expref: 11 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.011063:0:8122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619200, rc 0) 00000100:00100000:2.0:1788813167.011115:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+11:10558:x1875706307993728:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 4860us (5149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813167.011125:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:1.0:1788813167.017340:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3c6ef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5818:1875706322683648:192.168.203.13@tcp:105: 00010000:00010000:1.0:1788813167.017378:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813167.017455:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+10:2366:x1875706307993856:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 7354us (7781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813167.017470:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:3.0:1788813167.024920:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813167.025321:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307993984 00000100:00100000:2.0:1788813167.025335:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307993984 00002000:00100000:2.0:1788813167.025402:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff93ef368cc380 x1875706307993984/t0(0) o4->9c560788-da9a-41fd-952d-091d96dace11@192.168.203.13@tcp:738/0 lens 504/0 e 0 to 0 dl 1788813178 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788813167.025415:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93ef368cc380 with x1875706307993984 ext(0->12) 00002000:00010000:2.0:1788813167.025422:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ef368cc380 00000100:00100000:2.0:1788813167.025465:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:2.0:1788813167.025476:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9c560788-da9a-41fd-952d-091d96dace11+10:2365:x1875706307993984:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788813167.026915:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9c560788-da9a-41fd-952d-091d96dace11+12:2365:x1875706307993984:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 Request processed in 1431us (2012us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788813167.026929:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00002000:00100000:2.0:1788813167.027062:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff93ef368cc380 x1875706307993984/t4294967308(0) o4->9c560788-da9a-41fd-952d-091d96dace11@192.168.203.13@tcp:738/0 lens 504/448 e 0 to 0 dl 1788813178 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788813167.027074:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93ef368cc380 with x1875706307993984 ext(0->12) 00002000:00010000:2.0:1788813167.027081:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ef368cc380 00000100:00100000:3.0:1788813167.033661:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813167.033829:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307994112 00000100:00100000:0.0:1788813167.033843:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307994112 00000100:00100000:0.0:1788813167.033927:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00100000:0.0:1788813167.033946:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+61:10558:x1875706307994112:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788813167.136510:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+61:10558:x1875706307994112:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 102545us (102833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813167.136526:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 124 00000001:00080000:1.0:1788813167.137120:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967394 is committed 00000001:00080000:1.0:1788813167.137149:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:1.0:1788813167.137167:0:5856:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93ef2a1f4f00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788813167.137172:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ef36bb0300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93ef2a1f43c0 00000020:00080000:1.0:1788813167.137176:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ef36bb0500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93ef11effc00 00000004:00080000:1.0:1788813167.137195:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:1.0:1788813167.137231:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788813167.137247:0:5856:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93ef3e11c000 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788813167.137249:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ef20cf2e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93ef3e11c180 00000020:00080000:1.0:1788813167.137252:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ef20cf2400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93ef2ed34400 00000004:00080000:1.0:1788813167.137294:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:2.0:1788813167.137606:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322683904:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788813167.137677:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813167.137752:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813167.137759:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3c6ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322683776:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788813167.137816:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813167.137847:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788813167.137856:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322684032:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788813167.137898:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813167.137931:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322683904 00000100:00100000:2.0:1788813167.137959:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322683904 00000100:00100000:2.0:1788813167.138007:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322683776 00000100:00100000:2.0:1788813167.138010:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322683776 00000100:00100000:2.0:1788813167.138035:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322684032 00000100:00100000:2.0:1788813167.138038:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322684032 00000100:00100000:2.0:1788813167.138054:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788813167.138062:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3300:x1875706322683904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788813167.138094:0:6675:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1788813167.138127:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1eca98 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.138155:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f35b4e2/0x1b294f297b1ec85a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b72 expref: 11 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.138165:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788813167.138171:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813167.138176:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1eca98 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.138212:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f35b4e2/0x1b294f297b1ec85a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b72 expref: 11 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.138229:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f35b4e2/0x1b294f297b1ec85a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b72 expref: 11 pid: 6677 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813167.138243:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6675:1875706322684160:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788813167.138314:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e11c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788813167.138334:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788813167.138342:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3600ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1875706322683776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788813167.138357:0:6676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1788813167.138388:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f1f6d, atime: 0x6a9f1f6d, ctime: 0x6a9f1f6d, blocks: 0x1 00010000:00010000:2.0:1788813167.138396:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f70e8a67/0x1b294f297b1eca9f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.138406:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=327s v=(0 0) 00010000:00010000:2.0:1788813167.138410:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813167.138417:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f70e8a67/0x1b294f297b1eca9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.138437:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f70e8a67/0x1b294f297b1eca9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.138449:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f70e8a67/0x1b294f297b1eca9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.138459:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f70e8a67/0x1b294f297b1eca9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.138480:0:6676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788813167.139142:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3600ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3300:x1875706322683776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 799us (1323us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788813167.139152:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788813167.139184:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788813167.139192:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3302:x1875706322684032:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788813167.139312:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788813167.139316:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788813167 00002000:00010000:2.0:1788813167.139319:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788813167.139321:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788813166 -> 1788813167 00002000:00010000:2.0:1788813167.139324:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788813167.139369:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3302:x1875706322684032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 178us (1470us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788813167.139375:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1788813167.139405:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813167.139413:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f70e8a67/0x1b294f297b1eca9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.139423:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618a00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:2.0:1788813167.139428:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f70e8a67/0x1b294f297b1eca9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.139440:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f70e8a67/0x1b294f297b1eca9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.139460:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f70e8a67/0x1b294f297b1eca9f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.139468:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f70e8a67/0x1b294f297b1eca9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.139515:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813167.139517:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813167.139519:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788813167.139565:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ef3c6ef100/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788813167.139573:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3c6ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322683776:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788813167.139582:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ef368c4380/2, rc 0, transno 4294967309 00000100:00080000:2.0:1788813167.139595:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813167.139602:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322684032:0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1788813167.139859:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1788813167.140088:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788813167.140619:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813167.141594:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307994240 00000100:00100000:2.0:1788813167.141607:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307994240 00000100:00100000:2.0:1788813167.141827:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:2.0:1788813167.141840:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+12:2366:x1875706307994240:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788813167.144170:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813167.144217:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307994368 00000100:00100000:0.0:1788813167.144227:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307994368 00010000:00010000:0.0:1788813167.144281:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f35b4e2/0x1b294f297b1ec85a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b72 expref: 13 pid: 6677 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813167.144355:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:0.0:1788813167.144368:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef363d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+13:2365:x1875706307994368:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813167.144386:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813167.144393:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f35b4e2/0x1b294f297b1ec85a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b72 expref: 13 pid: 6677 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.144409:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f35b4e2/0x1b294f297b1ec85a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b72 expref: 13 pid: 6677 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.144442:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813167.144448:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813167.144456:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1eca98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.144467:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1eca98 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.144503:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813167.144563:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef363d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+13:2365:x1875706307994368:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 198us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813167.144572:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00010000:00010000:2.0:1788813167.145392:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f35b4e2/0x1b294f297b1ec85a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b72 expref: 12 pid: 6677 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813167.145413:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6675:1875706322684160:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788813167.145441:0:6675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1eca98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.145452:0:6675:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1eca98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.145460:0:6675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1eca98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.145473:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1eca98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.145505:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1eca98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.145523:0:6675:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788813167.146258:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3300:x1875706322683904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8193us (8577us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788813167.146271:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1788813167.146531:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813167.146541:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1eca98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.146552:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618000 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813167.146558:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1eca98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.146570:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1eca98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.146593:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1eca98 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.146602:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1eca98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.146627:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813167.146629:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813167.146630:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788813167.151479:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ef368c6d80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788813167.151511:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322683904:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1788813167.259672:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1788813167.259706:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1788813167.259712:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1788813167.260071:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+6:2366:x1875706307994240:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 118225us (119445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813167.260085:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:0.0:1788813167.262882:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813167.263040:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307994624 00000100:00100000:3.0:1788813167.263053:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307994624 00000100:00100000:3.0:1788813167.263129:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 125 00000100:00100000:3.0:1788813167.263141:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef363d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+15:10558:x1875706307994624:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788813167.263233:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813167.263270:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1eca83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c05 expref: 15 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.263295:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93ef1a079e00) 00010000:00010000:3.0:1788813167.263301:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813167.263341:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecaa6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.263358:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecaa6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.263371:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecaa6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813167.263708:0:7630:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048e982cd reply state 00000000f4d1c3e6 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecaa6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813167.263720:0:7630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788813167.263899:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef363d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+16:10558:x1875706307994624:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 760us (1029us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1788813167.263908:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 125 00010000:00010000:2.0:1788813167.265584:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecaa6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.265602:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecaa6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.265610:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecaa6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.265617:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813167.265623:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecaa6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.265633:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecaa6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.265673:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93ef1a079e00) 00010000:00010000:2.0:1788813167.265676:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813167.265683:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecaa6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.265690:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecaa6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813167.268699:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813167.268856:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307994752 00000100:00100000:2.0:1788813167.268868:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307994752 00000100:00100000:2.0:1788813167.269028:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:2.0:1788813167.269041:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef363d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+6:2364:x1875706307994752:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788813167.269326:0:8122:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788813167.269331:0:8122:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788813167 -> 1788813166 00002000:00010000:2.0:1788813167.269334:0:8122:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788813165 00002000:00010000:2.0:1788813167.269336:0:8122:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788813167 -> 1788813166 00002000:00010000:2.0:1788813167.269338:0:8122:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788813167.269411:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef363d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+7:2364:x1875706307994752:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 372us (725us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788813167.269419:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:3.0:1788813167.272510:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813167.273308:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307995008 00000100:00100000:2.0:1788813167.273323:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307995008 00000100:00100000:2.0:1788813167.273436:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 126 00000100:00100000:2.0:1788813167.273448:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+15:10558:x1875706307995008:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788813167.273552:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecaad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.273591:0:8565:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eca67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bf7 expref: 15 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.273602:0:8565:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecaad lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.273660:0:8565:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eca67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bf7 expref: 15 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.273677:0:8565:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eca67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bf7 expref: 15 pid: 8565 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813167.273694:0:8565:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8565:1875706322684288:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788813167.273835:0:8565:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef113a9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813167.277504:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813167.277622:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307995136 00000100:00100000:3.0:1788813167.277635:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307995136 00010000:00010000:3.0:1788813167.277684:0:8439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eca67 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bf7 expref: 16 pid: 8565 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813167.277730:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:3.0:1788813167.277742:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef363d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+16:2366:x1875706307995136:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813167.277770:0:8439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813167.277779:0:8439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eca67 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bf7 expref: 16 pid: 8565 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.277830:0:8439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eca67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bf7 expref: 16 pid: 8565 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.277859:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93ef1a079e00) 00010000:00010000:3.0:1788813167.277866:0:8439:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecaad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.277877:0:8439:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecaad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.277887:0:8439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecaad lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.277922:0:8439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813167.278002:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef363d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+16:2366:x1875706307995136:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 261us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813167.278009:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00010000:00010000:2.0:1788813167.281798:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eca67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bf7 expref: 15 pid: 8565 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813167.281837:0:8565:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8565:1875706322684288:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788813167.281869:0:8565:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecaad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.281883:0:8565:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecaad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.282067:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecaad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.282110:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecaad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.282143:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecaad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.282151:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecaad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.282158:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618a00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813167.282163:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecaad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.282171:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecaad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.282192:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93ef1a079e00) 00010000:00010000:2.0:1788813167.282195:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788813167.282201:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecaad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.282207:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecaad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813167.282396:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+14:10558:x1875706307995008:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 Request processed in 8948us (9909us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788813167.282407:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 126 00000100:00100000:2.0:1788813167.285526:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813167.285609:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307995264 00000100:00100000:1.0:1788813167.285622:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307995264 00000100:00100000:1.0:1788813167.285693:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:1.0:1788813167.285704:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+7:2363:x1875706307995264:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788813167.285760:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ecab4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.285810:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1eca91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c13 expref: 7 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.285841:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813167.285846:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788813167.285851:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ecab4 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.285906:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1eca91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c13 expref: 7 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.285921:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1eca91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c13 expref: 7 pid: 8122 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813167.285947:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3c6efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6675:1875706322684416:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788813167.286351:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a1f4780 going to sleep for 11 seconds 00000100:00100000:0.0:1788813167.289169:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3c6efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6675:1875706322684416:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788813167.289211:0:6675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ecab4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813167.290685:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813167.291067:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307995392 00000100:00100000:0.0:1788813167.291078:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307995392 00010000:00010000:0.0:1788813167.291129:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1eca91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c13 expref: 8 pid: 8122 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813167.291180:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:0.0:1788813167.291192:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+8:2366:x1875706307995392:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813167.291210:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813167.291241:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1eca91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c13 expref: 8 pid: 8122 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.291257:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1eca91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c13 expref: 8 pid: 8122 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.291285:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1eca91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c13 expref: 8 pid: 8122 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.291307:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813167.291312:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813167.291319:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ecab4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.291353:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ecab4 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.291388:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813167.291457:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+7:2366:x1875706307995392:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 267us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813167.291466:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00010000:00010000:3.0:1788813167.292345:0:6675:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ecab4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.292360:0:6675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ecab4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.292411:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ecab4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.292421:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ecab4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.292431:0:6675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ecab4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.292439:0:6675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fca00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813167.292444:0:6675:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ecab4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.292454:0:6675:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ecab4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.292472:0:6675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ecab4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.292479:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ecab4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813167.292577:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+6:2363:x1875706307995264:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 6873us (7063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813167.292587:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:3.0:1788813167.296268:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813167.296586:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307995648 00000100:00100000:0.0:1788813167.296600:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307995648 00000100:00100000:0.0:1788813167.296754:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 127 00000100:00100000:0.0:1788813167.296767:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+14:10558:x1875706307995648:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788813167.296919:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ecabb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.297253:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ecabb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.297271:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ecabb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.297564:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ecac2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.297578:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca75 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bfe expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.297587:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ecac2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.297664:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bfe expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.297680:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca75 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bfe expref: 15 pid: 5835 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813167.297696:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef363d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875706322684544:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788813167.297910:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef356039c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813167.311962:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813167.313832:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307995776 00000100:00100000:3.0:1788813167.313855:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307995776 00010000:00010000:3.0:1788813167.313920:0:8439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca75 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bfe expref: 16 pid: 5835 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813167.313979:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:3.0:1788813167.313992:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef363d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+16:2365:x1875706307995776:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813167.314011:0:8439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813167.314020:0:8439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca75 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bfe expref: 16 pid: 5835 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.314035:0:8439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca75 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bfe expref: 16 pid: 5835 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.314065:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93ef1a079e00) 00010000:00010000:3.0:1788813167.314071:0:8439:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ecac2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.314083:0:8439:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ecac2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.314091:0:8439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ecac2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.314120:0:8439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813167.314271:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef363d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+16:2365:x1875706307995776:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 281us (2328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813167.314281:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00010000:00010000:2.0:1788813167.316214:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1eca75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bfe expref: 15 pid: 5835 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813167.316248:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef363d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875706322684544:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788813167.316300:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ecac2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.316312:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ecac2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.316320:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ecac2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788813167.316588:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1788813167.316766:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1788813167.316861:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1788813167.318359:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368c7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5836:1875706322684672:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788813167.318478:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813167.318630:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef19c80480 going to sleep for 11 seconds 00000100:00100000:1.0:1788813167.323146:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322684672 00000100:00100000:1.0:1788813167.323167:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322684672 00000100:00100000:0.0:1788813167.323372:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788813167.323386:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1875706322684672:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788813167.323562:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1875706322684672:12345-0@lo:1000:mdt00_002.0 Request processed in 179us (5084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813167.323570:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788813167.323592:0:5836:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1788813167.323600:0:5836:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:3.0:1788813167.323695:0:5836:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ef368c4380, transno 4294967309 00000100:00100000:3.0:1788813167.323722:0:5836:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff93ef368c6d80 x1875706322683904/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788813183 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813167.323738:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368c7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5836:1875706322684672:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788813167.324348:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1788813167.324444:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5836:1875706322684800:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788813167.324510:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813167.324548:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef113a9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813167.324632:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322684800 00000100:00100000:1.0:1788813167.324639:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322684800 00000100:00100000:1.0:1788813167.324687:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788813167.324697:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1875706322684800:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788813167.325142:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5836:x1875706322684800:12345-0@lo:1000:mdt00_002.0 Request processed in 445us (630us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788813167.325149:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788813167.327717:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5836:1875706322684800:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788813167.327848:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ecac2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.327860:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ecac2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.327868:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ecac2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.327876:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cf600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813167.327880:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ecac2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.327890:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ecac2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.327908:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93ef1a079e00) 00010000:00010000:3.0:1788813167.327912:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813167.327940:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ecac2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.327947:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ecac2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.327990:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1eca05 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.327998:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1eca05 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.328005:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1eca05 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.328009:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef421e8c00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813167.328012:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1eca05 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.328018:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1eca05 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.328026:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:3.0:1788813167.328029:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813167.328037:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1eca0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2be2 expref: 18 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.328050:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1eca0c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2be2 expref: 18 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.328060:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1eca0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2be2 expref: 18 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813167.328141:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1eca0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2be2 expref: 18 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813167.328159:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3639c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875706322684928:192.168.203.13@tcp:105: 00000100:00100000:3.0:1788813167.328267:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef113a9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813167.333425:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813167.333549:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3639c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875706322684928:192.168.203.13@tcp:105: 00010000:00010000:2.0:1788813167.333587:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1eca05 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.333600:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1eca05 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.333643:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecac9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.333661:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecac9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.333676:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecac9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.333710:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecac9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.333718:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecac9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.333725:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecac9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.333731:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618a00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813167.333736:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecac9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.333744:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecac9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.333759:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:2.0:1788813167.333762:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813167.333766:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecac9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.333773:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecac9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.333812:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ecabb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.333819:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ecabb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.333825:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ecabb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.333839:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cfa00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813167.333842:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ecabb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.333848:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ecabb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.333856:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:2.0:1788813167.333859:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788813167.333862:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ecabb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.333868:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ecabb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813167.335309:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307995904 00000100:00100000:0.0:1788813167.335327:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307995904 00000100:00100000:0.0:1788813167.335413:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:0.0:1788813167.335425:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3c6edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+19:10556:x1875706307995904:12345-192.168.203.13@tcp:49:lfs.0 00000100:00100000:0.0:1788813167.335616:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3c6edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+19:10556:x1875706307995904:12345-192.168.203.13@tcp:49:lfs.0 Request processed in 192us (2204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813167.335625:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:2.0:1788813167.336453:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+18:10558:x1875706307995648:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 39683us (40192us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1788813167.336464:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 127 00000020:00080000:2.0:1788813167.336469:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788813167.336686:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813167.336692:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813167.337660:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788813167.337679:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788813167.343323:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813167.343431:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813167.343549:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307996416 00000100:00100000:2.0:1788813167.343562:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307996416 00000100:00100000:2.0:1788813167.343645:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00100000:2.0:1788813167.343657:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3c6ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+18:10556:x1875706307996416:12345-192.168.203.13@tcp:58:lfs.0 00000100:00100000:0.0:1788813167.344502:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307996160 00000100:00100000:0.0:1788813167.344513:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307996160 00000100:00100000:0.0:1788813167.344566:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:0.0:1788813167.344576:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef0e7fb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+19:10558:x1875706307996160:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788813167.346830:0:5837:0:(mdd_object.c:4199:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788813167.347160:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1788813167.347294:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3c6ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+20:10556:x1875706307996416:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 3631us (3853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813167.347306:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 128 00000001:00080000:0.0:1788813167.350076:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1788813167.350231:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ecad0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.350252:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ecad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.350267:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ecad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.350278:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ecad0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.350285:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ecad0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.350292:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ecad0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.350317:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788813167.350456:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef0e7fb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+20:10558:x1875706307996160:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 5875us (7141us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788813167.350468:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 32 00000020:00080000:0.0:1788813167.350475:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788813167.351815:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813167.351846:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ecad0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.351857:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cea00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:2.0:1788813167.351862:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ecad0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.351872:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ecad0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.351891:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93ef1a079700) 00010000:00010000:2.0:1788813167.351894:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788813167.351900:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ecad0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.351906:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ecad0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.351931:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813167.351933:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813167.351934:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813167.394974:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813167.395145:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307996544 00000100:00100000:2.0:1788813167.395158:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307996544 00000100:00100000:2.0:1788813167.395238:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 129 00000100:00100000:2.0:1788813167.395250:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3c6edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+20:10560:x1875706307996544:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813167.395282:0:8565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813167.395309:0:8565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecad7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2c1a expref: -99 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.395391:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecade lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.395431:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecade lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.395445:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecade lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.395462:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ecae5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.395469:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ecae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.395475:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ecae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.395816:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ecaec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.395829:0:8565:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ec9f7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bdb expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.395840:0:8565:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ecaec lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.395885:0:8565:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ec9f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bdb expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813167.395901:0:8565:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ec9f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bdb expref: 21 pid: 5834 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813167.395931:0:8565:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8565:1875706322685056:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788813167.396072:0:8565:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e11cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813167.406036:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813167.406133:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307996800 00000100:00100000:0.0:1788813167.406146:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307996800 00000100:00100000:1.0:1788813167.406187:0:8565:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8565:1875706322685056:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788813167.406221:0:8565:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ecaec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813167.406285:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:0.0:1788813167.406297:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3639ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+22:5598:x1875706307996800:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788813167.406625:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3639ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+23:5598:x1875706307996800:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 329us (601us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1788813167.406633:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:1.0:1788813167.413870:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813167.414090:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307996928 00000100:00100000:0.0:1788813167.414104:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307996928 00010000:00010000:0.0:1788813167.414162:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ec9f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bdb expref: 23 pid: 5834 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813167.414218:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:0.0:1788813167.414229:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef121e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+23:2365:x1875706307996928:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813167.414248:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813167.414255:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ec9f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bdb expref: 23 pid: 5834 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.414270:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ec9f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bdb expref: 23 pid: 5834 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.414299:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ec9f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2bdb expref: 23 pid: 5834 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.414319:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:0.0:1788813167.414325:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ecaec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.414338:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ecaec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.414365:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ecaec lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813167.414404:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813167.414472:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef121e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+22:2365:x1875706307996928:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 244us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813167.414481:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00010000:00010000:1.0:1788813167.417764:0:8565:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ecaec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.417828:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ecaec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813167.417897:0:8565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788813167.417903:0:8565:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813167.417931:0:8565:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ecaec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.417951:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ecaec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.417963:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecade lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.417970:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecade lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.417978:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecade lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.417985:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813167.417990:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecade lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.418031:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecade lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.418050:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:1.0:1788813167.418054:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813167.418060:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecade lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.418068:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecade lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.418087:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ecae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.418093:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ecae5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.418099:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ecae5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.418104:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813167.418107:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ecae5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.418113:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ecae5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.418121:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93ef10b7a500) 00010000:00010000:1.0:1788813167.418123:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813167.418126:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ecae5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.418143:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618600/0x1b294f297b1ecae5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.418197:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecad7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c1a expref: 22 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.418213:0:8565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ecaec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c1a expref: 21 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813167.418220:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:1.0:1788813167.418222:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813167.418225:0:8565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21618c00, rc 0) 00000100:00100000:1.0:1788813167.418327:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3c6edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+21:10560:x1875706307996544:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 23078us (23365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813167.418337:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 129 00010000:00010000:3.0:1788813167.583018:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788813168.343424:0:12103:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813168.343438:0:12103:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813168.343516:0:12103:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788813168.343524:0:12103:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788813168.350875:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788813168.350885:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788813168.350938:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788813168.350949:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788813168.351118:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368c6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1875706322685184:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788813168.351743:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e11c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788813168.357500:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813168.357762:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368c6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1875706322685184:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788813168.362504:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307997056 00000100:00100000:2.0:1788813168.362527:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307997056 00000100:00100000:2.0:1788813168.362643:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 130 00000100:00100000:2.0:1788813168.362658:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef363d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+21:10571:x1875706307997056:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788813168.362706:0:5836:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00080000:1.0:1788813168.362711:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813168.362998:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef363d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+21:10571:x1875706307997056:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 343us (5521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813168.363007:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 130 00000100:00100000:1.0:1788813168.367513:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813168.369575:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307997312 00000100:00100000:2.0:1788813168.369591:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307997312 00000100:00100000:2.0:1788813168.369681:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 131 00000100:00100000:2.0:1788813168.369692:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3c6eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+21:10571:x1875706307997312:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813168.369713:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813168.369732:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecaf3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2c21 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.369892:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecafa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.369908:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecafa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.369922:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecafa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813168.369933:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788813168.370061:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecaf3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c21 expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.370079:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecafa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c21 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813168.370088:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:2.0:1788813168.370090:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813168.370094:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21618a00, rc 0) 00000100:00100000:2.0:1788813168.370163:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3c6eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+23:10571:x1875706307997312:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 473us (2665us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788813168.370171:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 131 00000100:00100000:1.0:1788813168.378145:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813168.378231:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307997440 00000100:00100000:0.0:1788813168.378240:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307997440 00000100:00100000:0.0:1788813168.378302:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:0.0:1788813168.378312:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3c6efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+23:2365:x1875706307997440:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813168.378326:0:8439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813168.378350:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ecafa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c21 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813168.378367:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:0.0:1788813168.378373:0:8439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813168.378433:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3c6efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+22:2365:x1875706307997440:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 122us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813168.378440:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:1.0:1788813168.384257:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813168.390978:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307997696 00000100:00100000:3.0:1788813168.390991:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307997696 00000100:00100000:3.0:1788813168.391056:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 132 00000100:00100000:3.0:1788813168.391066:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+22:10571:x1875706307997696:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788813168.391139:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ecb08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.391155:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ecb08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.391165:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ecb08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.391329:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ecb08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.391337:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ecb08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.391344:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ecb08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.391362:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813168.391366:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ecb08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.391373:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ecb08 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.391385:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:3.0:1788813168.391387:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788813168.391392:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ecb08 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813168.391398:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ecb08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813168.391711:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+23:10571:x1875706307997696:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 644us (7459us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788813168.391719:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 132 00000040:00080000:0.0:1788813168.397007:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813168.397016:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813168.398150:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788813168.398164:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788813168.407522:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813168.407590:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307997952 00000100:00100000:3.0:1788813168.407600:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307997952 00000100:00100000:3.0:1788813168.407667:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:3.0:1788813168.407677:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+23:10571:x1875706307997952:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788813168.407942:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+24:10571:x1875706307997952:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 264us (428us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788813168.407950:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:2.0:1788813168.591176:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813168.591215:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813168.591249:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813168.591288:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813168.591320:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307998464 00000100:00100000:2.0:1788813168.591341:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307998464 00000100:00100000:2.0:1788813168.591405:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 138 00000100:00100000:0.0:1788813168.591405:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307998336 00000100:00100000:0.0:1788813168.591410:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307998336 00000100:00100000:2.0:1788813168.591425:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2366:x1875706307998464:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813168.591438:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307998208 00000100:00100000:0.0:1788813168.591441:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307998208 00000100:00100000:0.0:1788813168.591462:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:0.0:1788813168.591468:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2366:x1875706307998336:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813168.591507:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2366:x1875706307998464:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 94us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813168.591507:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2366:x1875706307998336:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 38us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813168.591514:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:2.0:1788813168.591515:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 138 00000100:00100000:0.0:1788813168.591531:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00080000:2.0:1788813168.591536:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813168.591538:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+7:2366:x1875706307998208:12345-192.168.203.13@tcp:400:kworker.0 00000100:00080000:2.0:1788813168.591540:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813168.591561:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+7:2366:x1875706307998208:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 24us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813168.591567:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:1.0:1788813168.591966:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307998080 00000100:00100000:1.0:1788813168.591972:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307998080 00000100:00100000:1.0:1788813168.592012:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 288 00000100:00100000:1.0:1788813168.592019:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+13:2366:x1875706307998080:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813168.592072:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+13:2366:x1875706307998080:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 53us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813168.592090:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 288 00010000:00010000:2.0:1788813168.606912:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813169.629143:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788813169.927740:0:6700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1788813169.927757:0:6700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1788813169.927768:0:6700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000040:00080000:2.0:1788813170.258951:0:12157:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788813170.258961:0:12157:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788813170.259014:0:12157:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788813170.259023:0:12157:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788813170.380506:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813170.380582:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307998720 00000100:00100000:3.0:1788813170.380591:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307998720 00000100:00100000:3.0:1788813170.380682:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 133 00000100:00100000:3.0:1788813170.380693:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+24:10592:x1875706307998720:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813170.380716:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813170.380736:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ecb0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2c28 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788813170.381797:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788813170.382951:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ecb16 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813170.382972:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ecb16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813170.382984:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ecb16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813170.383000:0:7630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788813170.383154:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ecb0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c28 expref: 27 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813170.383172:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ecb16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c28 expref: 26 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813170.383181:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:3.0:1788813170.383185:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788813170.383188:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164f800, rc 0) 00000100:00100000:3.0:1788813170.383266:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+26:10592:x1875706307998720:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 2575us (2768us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788813170.383274:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 133 00000100:00100000:3.0:1788813170.391854:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813170.391972:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307998848 00000100:00100000:1.0:1788813170.391983:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307998848 00000100:00100000:1.0:1788813170.392055:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 134 00000100:00100000:1.0:1788813170.392065:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3639f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+26:10592:x1875706307998848:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:1.0:1788813170.392144:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecb24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.392162:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecb24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.392174:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecb24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.392201:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecb24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.392209:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecb24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.392215:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecb24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.392221:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fc000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813170.392226:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecb24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.392244:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecb24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.392256:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:1.0:1788813170.392259:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788813170.392264:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecb24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813170.392270:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecb24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813170.392343:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3639f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+26:10592:x1875706307998848:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 279us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813170.392350:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 134 00000100:00100000:1.0:1788813170.469732:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813170.469968:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307998976 00000100:00100000:0.0:1788813170.469979:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307998976 00000100:00080000:2.0:1788813170.470127:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788813170.470217:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:0.0:1788813170.470229:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+6:2366:x1875706307998976:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:0.0:1788813170.470246:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813170.470268:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061a3daae/0x1b294f297b1ecb2b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2c2f expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788813170.470294:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f1f6e, atime: 0x6a9f1f6d, ctime: 0x6a9f1f6e, blocks: 0xb 00010000:00010000:0.0:1788813170.470313:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=330s v=(0 0) 00010000:00010000:0.0:1788813170.470329:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813170.470339:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061a3daae/0x1b294f297b1ecb2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c2f expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.470361:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000061a3daae/0x1b294f297b1ecb2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c2f expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813170.470375:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cf800, rc 0) 00000100:00100000:0.0:1788813170.470441:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+7:2366:x1875706307998976:12345-192.168.203.13@tcp:101:cat.0 Request processed in 214us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813170.470448:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:1.0:1788813170.485122:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813170.485241:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307999104 00000100:00100000:3.0:1788813170.485253:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307999104 00002000:00100000:3.0:1788813170.485309:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff93ef21247b80 x1875706307999104/t0(0) o3->9c560788-da9a-41fd-952d-091d96dace11@192.168.203.13@tcp:741/0 lens 488/0 e 0 to 0 dl 1788813181 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788813170.485320:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93ef21247b80 with x1875706307999104 ext(0->4095) 00002000:00010000:3.0:1788813170.485327:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ef21247b80 00000100:00100000:3.0:1788813170.485352:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:3.0:1788813170.485361:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9c560788-da9a-41fd-952d-091d96dace11+7:2365:x1875706307999104:12345-192.168.203.13@tcp:3:cat.0 00000100:00100000:3.0:1788813170.486174:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9c560788-da9a-41fd-952d-091d96dace11+7:2365:x1875706307999104:12345-192.168.203.13@tcp:3:cat.0 Request processed in 811us (1058us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788813170.486184:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00002000:00100000:3.0:1788813170.486191:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff93ef21247b80 x1875706307999104/t0(0) o3->9c560788-da9a-41fd-952d-091d96dace11@192.168.203.13@tcp:741/0 lens 488/4536 e 0 to 0 dl 1788813181 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788813170.486199:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93ef21247b80 with x1875706307999104 ext(0->4095) 00002000:00010000:3.0:1788813170.486204:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ef21247b80 00010000:00010000:2.0:1788813170.653382:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813171.357231:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322685312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813171.357405:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813171.357713:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3639f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322685440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813171.357750:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813171.358237:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef363d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322685696:0@lo:400:kworker.0 00000100:00100000:1.0:1788813171.358289:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813171.358332:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813171.358338:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef363d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322685824:0@lo:400:kworker.0 00000100:00100000:1.0:1788813171.358361:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813171.358394:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322685696 00000100:00100000:1.0:1788813171.358404:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322685696 00000100:00100000:1.0:1788813171.358471:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322685824 00000100:00100000:1.0:1788813171.358474:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322685824 00000100:00100000:1.0:1788813171.358514:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788813171.358542:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322685696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813171.358605:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322685696:12345-0@lo:400:kworker.0 Request processed in 65us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813171.358613:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788813171.358634:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788813171.358641:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322685824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813171.358668:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322685824:12345-0@lo:400:kworker.0 Request processed in 29us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813171.358674:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:1.0:1788813171.358699:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813171.358742:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef363d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322685824:0@lo:400:kworker.0 00000100:00100000:1.0:1788813171.358752:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef363d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322685696:0@lo:400:kworker.0 00000100:00100000:2.0:1788813171.360771:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322685312 00000100:00100000:2.0:1788813171.360809:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322685312 00000100:00100000:2.0:1788813171.360883:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322685440 00000100:00100000:2.0:1788813171.360886:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322685440 00000100:00100000:2.0:1788813171.360907:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788813171.360917:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1875706322685312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813171.360967:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813171.361059:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1875706322685312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (3656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813171.361067:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788813171.361087:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788813171.361110:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3639ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322685440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813171.361133:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813171.361162:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3639ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322685440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (3411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813171.361168:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788813171.361203:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef363d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322685568:0@lo:400:kworker.0 00000100:00100000:2.0:1788813171.361253:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813171.361292:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef363d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1875706322686080:0@lo:400:kworker.0 00000100:00100000:3.0:1788813171.361434:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000100:00080000:1.0:1788813171.362333:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788813171.362342:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813171.362397:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322685312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813171.363209:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813171.363264:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788813171.363332:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322686080 00000100:00100000:0.0:1788813171.363343:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322686080 00000004:00080000:3.0:1788813171.363383:0:3299:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000100:00080000:1.0:1788813171.363399:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1788813171.363412:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ef3c6ef100, transno 4294967304 00000100:00100000:2.0:1788813171.363439:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef363d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322685952:0@lo:400:kworker.0 00000100:00100000:3.0:1788813171.363440:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3639f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322685440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813171.363517:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788813171.363520:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322685568 00000100:00100000:3.0:1788813171.363525:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322685568 00000100:00100000:0.0:1788813171.363532:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875706322686080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813171.363558:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788813171.363564:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813171.363567:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3300:x1875706322685568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813171.363599:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875706322686080:12345-0@lo:400:kworker.0 Request processed in 71us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813171.363606:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788813171.363623:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3300:x1875706322685568:12345-0@lo:400:kworker.0 Request processed in 59us (2371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813171.363630:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788813171.363668:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322685952 00000100:00100000:3.0:1788813171.363672:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322685952 00000100:00100000:3.0:1788813171.363708:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788813171.363715:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322685952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813171.363745:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322685952:12345-0@lo:400:kworker.0 Request processed in 31us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813171.363750:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788813171.364096:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef363d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322685952:0@lo:400:kworker.0 00000100:00100000:2.0:1788813171.364109:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef363d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322685568:0@lo:400:kworker.0 00000100:00100000:2.0:1788813171.364119:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef363d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1875706322686080:0@lo:400:kworker.0 00010000:00010000:2.0:1788813171.677747:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788813172.488951:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1788813172.488973:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1788813172.494458:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967409 is committed 00000020:00080000:1.0:1788813172.494491:0:5856:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:1.0:1788813172.494515:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000001:00080000:1.0:1788813172.494535:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1788813172.494550:0:5856:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93ef1caf3780 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788813172.494555:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ef190e1400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93ef1caf3e40 00000020:00080000:1.0:1788813172.494558:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ef190e1700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93ef36960800 00000020:00080000:2.0:1788813172.494619:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788813172.494863:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1788813172.701741:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788813173.533271:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788813173.533281:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788813173.533569:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1788813173.533576:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788813173.711371:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813173.711412:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813173.711498:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813173.711528:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813173.711557:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813173.711633:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307999744 00000100:00100000:1.0:1788813173.711643:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307999744 00000100:00100000:1.0:1788813173.711712:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307999360 00000100:00100000:1.0:1788813173.711716:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307999360 00000100:00100000:1.0:1788813173.711738:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 142 00000100:00100000:1.0:1788813173.711747:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3639c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2364:x1875706307999744:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813173.711847:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3639c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2364:x1875706307999744:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 101us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813173.711856:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 142 00000100:00100000:1.0:1788813173.711872:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 143 00000100:00100000:1.0:1788813173.711879:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3639e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+13:2364:x1875706307999360:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813173.711916:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3639e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+13:2364:x1875706307999360:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 37us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813173.711922:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 143 00000100:00080000:1.0:1788813173.711939:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813173.712287:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307999232 00000100:00100000:2.0:1788813173.712293:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307999232 00000100:00100000:2.0:1788813173.712332:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 290 00000100:00100000:2.0:1788813173.712339:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+13:2364:x1875706307999232:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813173.712372:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+13:2364:x1875706307999232:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 34us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813173.712388:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 290 00000100:00100000:0.0:1788813173.727419:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307999488 00000100:00100000:0.0:1788813173.727434:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307999488 00000100:00100000:0.0:1788813173.727529:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307999616 00000100:00100000:0.0:1788813173.727532:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307999616 00000100:00100000:0.0:1788813173.727561:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:0.0:1788813173.727571:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3639f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+5:2364:x1875706307999488:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813173.727672:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3639f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+5:2364:x1875706307999488:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 102us (16258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813173.728064:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:0.0:1788813173.728100:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:0.0:1788813173.728107:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3639df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+6:2364:x1875706307999616:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813173.728139:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3639df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+6:2364:x1875706307999616:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 32us (16581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813173.728145:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00080000:3.0:1788813173.728636:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813173.728642:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788813173.729196:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813174.755891:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813175.243345:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813175.243473:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706307999872 00000100:00100000:1.0:1788813175.243482:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706307999872 00000100:00100000:1.0:1788813175.243547:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 135 00000100:00100000:1.0:1788813175.243558:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+13:10237:x1875706307999872:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788813175.243661:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+13:10237:x1875706307999872:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 Request processed in 105us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813175.243668:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 135 00000100:00080000:3.0:1788813175.245628:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813175.246580:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813175.246849:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308000128 00000100:00100000:1.0:1788813175.246860:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308000128 00000100:00100000:1.0:1788813175.246918:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:1.0:1788813175.246929:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef363d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+13:10237:x1875706308000128:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788813175.249557:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef363d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+14:10237:x1875706308000128:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 2618us (2971us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788813175.249572:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00010000:00010000:3.0:1788813175.775480:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813176.477072:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322686208:0@lo:400:kworker.0 00000100:00100000:2.0:1788813176.477142:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813176.477589:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322686720:0@lo:400:kworker.0 00000100:00100000:2.0:1788813176.477625:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813176.477656:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788813176.477662:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322686336:0@lo:400:kworker.0 00000100:00100000:2.0:1788813176.477685:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813176.477704:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322686848:0@lo:400:kworker.0 00000100:00100000:2.0:1788813176.477726:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813176.477762:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322686464:0@lo:400:kworker.0 00000100:00100000:2.0:1788813176.477812:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813176.477832:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813176.477837:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3e33ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322686592:0@lo:400:kworker.0 00000100:00100000:2.0:1788813176.477857:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813176.477891:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322686208 00000100:00100000:2.0:1788813176.478565:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322686208 00000100:00100000:2.0:1788813176.478624:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788813176.478634:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3301:x1875706322686208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813176.478694:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3301:x1875706322686208:12345-0@lo:400:kworker.0 Request processed in 61us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813176.478700:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788813176.478738:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322686720 00000100:00100000:2.0:1788813176.478754:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322686720 00000100:00100000:2.0:1788813176.478812:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322686336 00000100:00100000:2.0:1788813176.478816:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322686336 00000100:00100000:2.0:1788813176.478833:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322686464 00000100:00100000:2.0:1788813176.478835:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322686464 00000100:00100000:2.0:1788813176.478851:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788813176.478857:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875706322686720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813176.478888:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875706322686720:12345-0@lo:400:kworker.0 Request processed in 32us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813176.478894:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788813176.479270:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788813176.479278:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322686336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813176.479311:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322686336:12345-0@lo:400:kworker.0 Request processed in 35us (1625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813176.479317:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788813176.479329:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788813176.479335:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3696d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322686464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813176.479368:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3696d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322686464:12345-0@lo:400:kworker.0 Request processed in 33us (1554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813176.479374:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788813176.479450:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813176.479460:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3696e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322686976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813176.479490:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788813176.479669:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813176.479705:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322686336:0@lo:400:kworker.0 00000100:00100000:3.0:1788813176.479718:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322686208:0@lo:400:kworker.0 00000100:00100000:3.0:1788813176.479729:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322686720:0@lo:400:kworker.0 00000100:00100000:3.0:1788813176.479775:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322686464:0@lo:400:kworker.0 00000100:00100000:0.0:1788813176.480254:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322686848 00000100:00100000:0.0:1788813176.480260:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322686848 00000100:00100000:2.0:1788813176.480290:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef363d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322687104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813176.480305:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322686592 00000100:00100000:0.0:1788813176.480309:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322686592 00000100:00100000:2.0:1788813176.480324:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813176.480352:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322686976 00000100:00100000:2.0:1788813176.480356:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322686976 00000100:00100000:2.0:1788813176.480390:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322687104 00000100:00100000:2.0:1788813176.480393:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322687104 00000100:00100000:2.0:1788813176.480407:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788813176.480413:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875706322686976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813176.480451:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813176.480490:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875706322686976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813176.481003:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788813176.481021:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788813176.481029:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875706322687104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813176.481050:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813176.481084:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875706322687104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813176.481090:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788813176.481128:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef363d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322687104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813176.481139:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1788813176.481143:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ef368c6d80, transno 4294967310 00000004:00080000:2.0:1788813176.481155:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1788813176.481179:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3696e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322686976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813176.481429:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788813176.481440:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322686848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813176.481483:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322686848:12345-0@lo:400:kworker.0 Request processed in 47us (3756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813176.481489:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788813176.481505:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788813176.481511:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3696ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322686592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813176.481537:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3696ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322686592:12345-0@lo:400:kworker.0 Request processed in 27us (3679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813176.481542:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1788813176.481885:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788813176.481890:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788813176.481914:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3e33ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322686592:0@lo:400:kworker.0 00000100:00100000:0.0:1788813176.481942:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322686848:0@lo:400:kworker.0 00010000:00010000:3.0:1788813176.797273:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788813177.111445:0:12356:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 16:32:55 (1788813175) 00000001:00080000:3.0:1788813177.550546:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1788813177.550574:0:5856:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1788813177.550634:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788813177.550654:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1788813177.821166:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813178.241660:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813178.241768:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308000384 00000100:00100000:2.0:1788813178.241811:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308000384 00000100:00100000:2.0:1788813178.242001:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 136 00000100:00100000:2.0:1788813178.242018:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3639fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+13:11302:x1875706308000384:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813178.242044:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813178.242080:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecb32 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2c36 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813178.242150:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ecb39 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813178.242164:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ecb39 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813178.242175:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ecb39 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813178.242189:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecb40 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813178.242195:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecb40 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813178.242201:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecb40 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788813178.242666:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788813178.242934:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecb47 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813178.242946:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecb47 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813178.242954:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecb47 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813178.242964:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788813178.243130:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ecb39 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813178.243150:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ecb39 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813178.243156:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ecb39 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813178.243162:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813178.243165:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ecb39 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813178.243172:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ecb39 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813178.243184:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93ef1a079f00) 00010000:00010000:2.0:1788813178.243187:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813178.243192:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ecb39 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813178.243197:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ecb39 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813178.243209:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecb40 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813178.243215:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecb40 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813178.243220:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecb40 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813178.243224:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619c00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813178.243233:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecb40 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813178.243239:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecb40 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813178.243248:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93ef10b7a600) 00010000:00010000:2.0:1788813178.243250:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813178.243253:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecb40 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813178.243259:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecb40 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813178.245152:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecb32 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c36 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813178.245177:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecb47 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c36 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813178.245186:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ef077b4200) 00010000:00010000:2.0:1788813178.245189:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813178.245193:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619e00, rc 0) 00000100:00100000:2.0:1788813178.245284:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3639fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+15:11302:x1875706308000384:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 3268us (3637us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1788813178.245293:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 136 00000100:00100000:2.0:1788813178.256841:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813178.256885:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813178.256998:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308000512 00000100:00100000:3.0:1788813178.257008:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308000512 00000100:00100000:3.0:1788813178.257062:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:3.0:1788813178.257071:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3696e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+15:2366:x1875706308000512:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813178.257084:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813178.257109:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecb47 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c36 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813178.257127:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ef077b4200) 00010000:00010000:3.0:1788813178.257132:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813178.257186:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3696e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+14:2366:x1875706308000512:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 116us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813178.257194:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:1.0:1788813178.260910:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308000640 00000100:00100000:1.0:1788813178.260924:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308000640 00000100:00100000:1.0:1788813178.261045:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 137 00000100:00100000:1.0:1788813178.261055:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+14:11302:x1875706308000640:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788813178.261165:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+14:11302:x1875706308000640:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 Request processed in 111us (4278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813178.261171:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 137 00000040:00080000:2.0:1788813178.657726:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788813178.657738:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788813178.658263:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788813178.658277:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788813178.828856:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813178.828898:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813178.828923:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813178.828945:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813178.828973:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308000896 00000100:00100000:3.0:1788813178.828982:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308000896 00000100:00100000:3.0:1788813178.829037:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308001024 00000100:00100000:3.0:1788813178.829041:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308001024 00000100:00100000:3.0:1788813178.829067:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:3.0:1788813178.829077:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3639ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+5:2364:x1875706308000896:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813178.829155:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3639ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+5:2364:x1875706308000896:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 79us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813178.829163:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:3.0:1788813178.829180:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:3.0:1788813178.829187:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3639dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+6:2364:x1875706308001024:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813178.829212:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3639dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+6:2364:x1875706308001024:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 26us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813178.829218:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00080000:3.0:1788813178.829235:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813178.829238:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813178.829324:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308000768 00000100:00100000:1.0:1788813178.829328:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308000768 00000100:00100000:1.0:1788813178.829367:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 292 00000100:00100000:1.0:1788813178.829374:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+13:2364:x1875706308000768:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813178.829401:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+13:2364:x1875706308000768:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 28us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813178.829418:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 292 00000100:00100000:2.0:1788813178.829908:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308001152 00000100:00100000:2.0:1788813178.829915:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308001152 00000100:00080000:3.0:1788813178.829967:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813178.829972:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 147 00000100:00100000:2.0:1788813178.829982:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3639d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2364:x1875706308001152:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813178.830017:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3639d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2364:x1875706308001152:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 37us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813178.830024:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 147 00010000:00010000:3.0:1788813178.851484:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813179.874284:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813180.133110:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813180.133339:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308001280 00000100:00100000:1.0:1788813180.133349:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308001280 00000100:00100000:1.0:1788813180.133424:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 138 00000100:00100000:1.0:1788813180.133434:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3639ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+14:11344:x1875706308001280:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813180.133465:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813180.133485:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecb55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2c3d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.133543:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecb5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.133556:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecb5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.133567:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecb5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.133579:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ecb63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.133585:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ecb63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.133590:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ecb63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.133766:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecb5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.133774:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecb5c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.133803:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecb5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.133810:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fc800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813180.133820:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecb5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.133828:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecb5c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788813180.133937:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788813180.134007:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef1a079900) 00010000:00010000:1.0:1788813180.134012:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813180.134019:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecb5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.134026:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecb5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.134038:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ecb63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.134044:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ecb63 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.134051:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ecb63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.134056:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fc200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813180.134058:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ecb63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.134064:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ecb63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.134072:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93ef19f1fc00) 00010000:00010000:1.0:1788813180.134074:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813180.134085:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ecb63 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.134090:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ecb63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.134123:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecb55 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c3d expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.134133:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef1a079900) 00010000:00010000:1.0:1788813180.134136:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813180.134139:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecb55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c3d expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.134148:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fc000, rc 0) 00000100:00100000:1.0:1788813180.134214:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3639ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+14:11344:x1875706308001280:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 781us (1112us total) trans 0 rc 301/301 00000100:00100000:1.0:1788813180.134221:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 138 00000100:00100000:2.0:1788813180.149067:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813180.149112:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308001536 00000100:00100000:1.0:1788813180.149122:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308001536 00000100:00100000:1.0:1788813180.149185:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 139 00000100:00100000:1.0:1788813180.149194:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+14:11344:x1875706308001536:12345-192.168.203.13@tcp:36:lfs.0 00010000:00010000:1.0:1788813180.149244:0:8565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813180.149269:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031200/0x1b294f297b1ec4e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a7d expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.149288:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef1a079900) 00010000:00010000:1.0:1788813180.149298:0:8565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788813180.149516:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ecb6a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.149530:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ecb6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.149541:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ecb6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.149553:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ecb71 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.149560:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ecb71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.149567:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ecb71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813180.153183:0:8565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788813180.153205:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ecb6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.153216:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ecb6a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.153225:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ecb6a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.153232:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fc400 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813180.153236:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ecb6a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.153244:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ecb6a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.153269:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:1.0:1788813180.153273:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813180.153278:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ecb6a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.153285:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ecb6a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788813180.153305:0:8565:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d175031f reply state 00000000f7bd6de7 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ecb71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813180.153314:0:8565:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788813180.153429:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+15:11344:x1875706308001536:12345-192.168.203.13@tcp:36:lfs.0 Request processed in 4232us (4366us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788813180.153438:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 139 00010000:00010000:1.0:1788813180.162084:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ecb71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.162103:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ecb71 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.162110:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ecb71 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.162117:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fcc00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813180.162122:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ecb71 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.162129:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ecb71 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.162157:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93ef19f1f300) 00010000:00010000:1.0:1788813180.162160:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813180.162165:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ecb71 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.162172:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ecb71 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813180.255582:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813180.257198:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308001664 00000100:00100000:2.0:1788813180.257210:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308001664 00000100:00100000:2.0:1788813180.257280:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 140 00000100:00100000:2.0:1788813180.257291:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+14:11352:x1875706308001664:12345-192.168.203.13@tcp:101:lctl.0 00010000:00010000:2.0:1788813180.257315:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813180.257338:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ecb78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2c44 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.257412:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ecb7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.257434:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ecb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.257446:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ecb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813180.257481:0:7630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788813180.257485:0:7630:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788813180.257516:0:7630:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ecb7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.257547:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ecb78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c44 expref: 16 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.257561:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ecb7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c44 expref: 15 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.257571:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef10b7a600) 00010000:00010000:2.0:1788813180.257573:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813180.257577:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21618000, rc 0) 00000100:00100000:2.0:1788813180.257647:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+15:11352:x1875706308001664:12345-192.168.203.13@tcp:101:lctl.0 Request processed in 358us (2075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813180.257655:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 140 00000100:00100000:0.0:1788813180.329831:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813180.329962:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308001792 00000100:00100000:1.0:1788813180.329971:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308001792 00000100:00100000:1.0:1788813180.330036:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 141 00000100:00100000:1.0:1788813180.330047:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef363d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+15:11358:x1875706308001792:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788813180.330068:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813180.330089:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ecb86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2c4b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.330156:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ecb8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.330172:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ecb8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.330184:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ecb8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.330200:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecb94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.330207:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecb94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.330228:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecb94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.330323:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ecb9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.330332:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ecb9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.330339:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ecb9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813180.330365:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788813180.330368:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813180.330386:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ecb9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.330410:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ecb8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.330417:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ecb8d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.330424:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ecb8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.330430:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fc400 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813180.330434:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ecb8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.330442:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ecb8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.330462:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef10b7a600) 00010000:00010000:1.0:1788813180.330464:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813180.330470:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ecb8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.330477:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ecb8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.330490:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecb94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.330497:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecb94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.330503:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecb94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.330508:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fc000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813180.330511:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecb94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.330517:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecb94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.330524:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93ef19f1f300) 00010000:00010000:1.0:1788813180.330526:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813180.330529:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecb94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.330534:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecb94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.330573:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ecb86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c4b expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.330585:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ecb9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c4b expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.330593:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:1.0:1788813180.330595:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788813180.330597:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fc200, rc 0) 00000100:00100000:1.0:1788813180.330664:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef363d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+16:11358:x1875706308001792:12345-192.168.203.13@tcp:101:bash.0 Request processed in 620us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813180.330671:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 141 00000100:00100000:0.0:1788813180.339467:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813180.339562:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308002048 00000100:00100000:2.0:1788813180.339571:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308002048 00000100:00100000:2.0:1788813180.339632:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 142 00000100:00100000:2.0:1788813180.339643:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef363d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+16:11358:x1875706308002048:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1788813180.339662:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813180.339683:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ecba2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2c52 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.339851:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecba9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.339867:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecba9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.339896:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecba9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.339910:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecbb0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.339917:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecbb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.339924:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecbb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788813180.340433:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788813180.340573:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecbb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.340583:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.340591:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.340618:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecba9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.340625:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecba9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.340632:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecba9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.340638:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619c00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813180.340647:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecba9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.340655:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecba9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.340666:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:2.0:1788813180.340669:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813180.340674:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecba9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.340681:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecba9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788813180.340692:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005730a817 reply state 00000000b315bde3 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecbb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813180.340699:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788813180.340723:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ecba2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c52 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.340736:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecbb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c52 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.340744:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef10b7ae00) 00010000:00010000:2.0:1788813180.340747:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813180.340749:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619e00, rc 0) 00000100:00100000:2.0:1788813180.340857:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef363d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+19:11358:x1875706308002048:12345-192.168.203.13@tcp:101:bash.0 Request processed in 1216us (1399us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788813180.340865:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 142 00010000:00010000:2.0:1788813180.343656:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecbb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.343672:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecbb0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.343680:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecbb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.343686:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813180.343691:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecbb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.343699:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecbb0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.343714:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ef10b7a400) 00010000:00010000:2.0:1788813180.343716:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813180.343721:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecbb0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.343727:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecbb0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813180.347001:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813180.347165:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308002176 00000100:00100000:3.0:1788813180.347175:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308002176 00000100:00100000:3.0:1788813180.347317:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:3.0:1788813180.347328:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef363d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+5:2365:x1875706308002176:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1788813180.347348:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813180.347369:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074d3a795/0x1b294f297b1ecbc5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2c59 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788813180.347407:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813180.347427:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1788813180.347432:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813180.347442:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074d3a795/0x1b294f297b1ecbc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c59 expref: 6 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813180.347476:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000074d3a795/0x1b294f297b1ecbc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c59 expref: 6 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813180.347490:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164f000, rc 0) 00000100:00100000:3.0:1788813180.347550:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef363d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+6:2365:x1875706308002176:12345-192.168.203.13@tcp:101:bash.0 Request processed in 224us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813180.347557:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00080000:0.0:1788813180.347610:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813180.362095:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813180.362238:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308002304 00000100:00100000:3.0:1788813180.362248:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308002304 00000100:00100000:3.0:1788813180.362303:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:3.0:1788813180.362322:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+6:11358:x1875706308002304:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1788813180.362339:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813180.362357:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b65c4a36/0x1b294f297b1ecbcc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2c60 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813180.362388:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000074d3a795/0x1b294f297b1ecbc5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c59 expref: 7 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813180.362409:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813180.362414:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813180.362420:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b65c4a36/0x1b294f297b1ecbcc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c60 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813180.362457:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000074d3a795/0x1b294f297b1ecbc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c59 expref: 7 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813180.362484:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000074d3a795/0x1b294f297b1ecbc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c59 expref: 7 pid: 6675 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813180.362497:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3639e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6677:1875706322687232:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788813180.362597:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef20e1f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788813180.369676:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813180.369856:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308002432 00000100:00100000:1.0:1788813180.369866:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308002432 00010000:00010000:1.0:1788813180.369922:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000074d3a795/0x1b294f297b1ecbc5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c59 expref: 8 pid: 6675 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813180.369970:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:1.0:1788813180.369979:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+8:2365:x1875706308002432:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813180.369994:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813180.370017:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000074d3a795/0x1b294f297b1ecbc5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c59 expref: 8 pid: 6675 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.370031:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000074d3a795/0x1b294f297b1ecbc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c59 expref: 8 pid: 6675 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.370071:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813180.370076:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813180.370085:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b65c4a36/0x1b294f297b1ecbcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c60 expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.370096:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b65c4a36/0x1b294f297b1ecbcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c60 expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.370135:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b65c4a36/0x1b294f297b1ecbcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c60 expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813180.370150:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3c6ef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1875706322687360:192.168.203.13@tcp:105: 00000100:00100000:1.0:1788813180.370234:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a1f4cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1788813180.370255:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074d3a795/0x1b294f297b1ecbc5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c59 expref: 8 pid: 6675 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813180.370272:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3639e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6677:1875706322687232:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788813180.370297:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b65c4a36/0x1b294f297b1ecbcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c60 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813180.370306:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164e000, rc 0) 00000100:00100000:3.0:1788813180.370337:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+7:11358:x1875706308002304:12345-192.168.203.13@tcp:101:bash.0 Request processed in 8018us (8251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813180.370344:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:0.0:1788813180.384237:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813180.384358:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308002688 00000100:00100000:3.0:1788813180.384369:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308002688 00000100:00100000:3.0:1788813180.384435:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:3.0:1788813180.384445:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef363d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+18:11358:x1875706308002688:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:3.0:1788813180.384774:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef363d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+19:11358:x1875706308002688:12345-192.168.203.13@tcp:35:bash.0 Request processed in 330us (546us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788813180.384818:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:2.0:1788813180.385125:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3c6ef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1875706322687360:192.168.203.13@tcp:105: 00010000:00010000:2.0:1788813180.385147:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813180.385174:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+6:2365:x1875706308002432:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 15196us (15506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813180.385183:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:2.0:1788813180.459900:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813180.460008:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308002944 00000100:00100000:0.0:1788813180.460019:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308002944 00000100:00100000:0.0:1788813180.460082:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 143 00000100:00100000:0.0:1788813180.460092:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+19:11368:x1875706308002944:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813180.460116:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813180.460139:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecbd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2c67 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813180.460237:0:7630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788813180.460364:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecbd3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c67 expref: 21 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.460380:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef10b7a600) 00010000:00010000:0.0:1788813180.460383:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788813180.460389:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecbd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c67 expref: 21 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.460419:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cf000, rc 0) 00000100:00100000:0.0:1788813180.460496:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+20:11368:x1875706308002944:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 404us (659us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1788813180.460505:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 143 00000100:00100000:2.0:1788813180.466921:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813180.467105:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308003200 00000100:00100000:3.0:1788813180.467114:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308003200 00000100:00100000:3.0:1788813180.467177:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:3.0:1788813180.467187:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+20:11368:x1875706308003200:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1788813180.467430:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+21:11368:x1875706308003200:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 244us (520us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788813180.467438:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:2.0:1788813180.561763:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813180.561974:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308003328 00000100:00100000:1.0:1788813180.561984:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308003328 00000100:00100000:1.0:1788813180.562505:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 144 00000100:00100000:1.0:1788813180.562518:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+21:11374:x1875706308003328:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813180.562544:0:8565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813180.562566:0:8565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ecbe1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2c6e expref: -99 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.562627:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecbe8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.562639:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecbe8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.562666:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecbe8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813180.562701:0:8565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788813180.562704:0:8565:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813180.562722:0:8565:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecbe8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.562748:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ecbe1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c6e expref: 23 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.562766:0:8565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecbe8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c6e expref: 22 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.562774:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:1.0:1788813180.562776:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813180.562826:0:8565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fc000, rc 0) 00000100:00100000:1.0:1788813180.562901:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+22:11374:x1875706308003328:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 387us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813180.562908:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 144 00000100:00100000:2.0:1788813180.575073:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813180.575196:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308003584 00000100:00100000:0.0:1788813180.575208:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308003584 00000100:00100000:0.0:1788813180.575278:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 145 00000100:00100000:0.0:1788813180.575288:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+22:11374:x1875706308003584:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813180.575308:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813180.575328:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecbef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2c75 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.575437:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecbf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.575453:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecbf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.575467:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecbf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813180.575478:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788813180.575607:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecbef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c75 expref: 25 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.575626:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecbf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c75 expref: 24 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.575634:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef10b7ae00) 00010000:00010000:0.0:1788813180.575637:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813180.575640:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cee00, rc 0) 00000100:00100000:0.0:1788813180.575705:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+24:11374:x1875706308003584:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 419us (642us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1788813180.575729:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 145 00000100:00100000:3.0:1788813180.584915:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813180.585491:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308003968 00000100:00100000:1.0:1788813180.585501:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308003968 00000100:00100000:1.0:1788813180.585566:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 146 00000100:00100000:1.0:1788813180.585577:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3639e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+24:11374:x1875706308003968:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813180.585604:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813180.585628:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ecc04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2c7c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.585757:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecc0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.585772:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecc0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.585835:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecc0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813180.585849:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788813180.585981:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ecc04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c7c expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.586000:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecc0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c7c expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.586008:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef10b7ae00) 00010000:00010000:1.0:1788813180.586011:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788813180.586014:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fc800, rc 0) 00000100:00100000:1.0:1788813180.586080:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3639e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+26:11374:x1875706308003968:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 505us (1175us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788813180.586088:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 146 00000100:00100000:3.0:1788813180.586215:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813180.586507:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308003712 00000100:00100000:0.0:1788813180.586514:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308003712 00000100:00100000:0.0:1788813180.586558:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:0.0:1788813180.586566:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3639d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+26:2365:x1875706308003712:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813180.586579:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813180.586596:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecbf6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c75 expref: 26 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.586622:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef10b7ae00) 00010000:00010000:0.0:1788813180.586626:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813180.586663:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3639d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+25:2365:x1875706308003712:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 98us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813180.586670:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:3.0:1788813180.604691:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813180.604914:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308004096 00000100:00100000:1.0:1788813180.604924:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308004096 00000100:00100000:1.0:1788813180.604992:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:1.0:1788813180.605002:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3639c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+6:2365:x1875706308004096:12345-192.168.203.13@tcp:1:lfs.0 00010000:00010000:1.0:1788813180.605049:0:8122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000362407a8/0x1b294f297b1ecc19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.605080:0:8122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b65c4a36/0x1b294f297b1ecbcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c60 expref: 6 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.605089:0:8122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813180.605093:0:8122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788813180.605097:0:8122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000362407a8/0x1b294f297b1ecc19 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.605131:0:8122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b65c4a36/0x1b294f297b1ecbcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c60 expref: 6 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.605216:0:8122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b65c4a36/0x1b294f297b1ecbcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c60 expref: 6 pid: 6677 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813180.605231:0:8122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3c6ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8122:1875706322687488:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788813180.605328:0:8122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a1f4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813180.608762:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813180.609413:0:8122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3c6ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8122:1875706322687488:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788813180.609443:0:8122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000362407a8/0x1b294f297b1ecc19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813180.609931:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308004224 00000100:00100000:3.0:1788813180.609940:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308004224 00002000:00100000:3.0:1788813180.609990:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff93ef36177800 x1875706308004224/t0(0) o4->9c560788-da9a-41fd-952d-091d96dace11@192.168.203.13@tcp:751/0 lens 504/0 e 0 to 0 dl 1788813191 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788813180.610000:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93ef36177800 with x1875706308004224 ext(0->12) 00010000:00010000:3.0:1788813180.610008:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b65c4a36/0x1b294f297b1ecbcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c60 expref: 7 pid: 6677 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813180.610023:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b65c4a36/0x1b294f297b1ecbcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c60 expref: 7 pid: 6677 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788813180.610031:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93ef36177800 00000100:00100000:3.0:1788813180.610068:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:3.0:1788813180.610078:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36177800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9c560788-da9a-41fd-952d-091d96dace11+7:2364:x1875706308004224:12345-192.168.203.13@tcp:4:lfs.0 00000100:00100000:3.0:1788813180.610588:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36177800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9c560788-da9a-41fd-952d-091d96dace11+9:2364:x1875706308004224:12345-192.168.203.13@tcp:4:lfs.0 Request processed in 510us (1834us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788813180.610606:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00002000:00100000:3.0:1788813180.610615:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff93ef36177800 x1875706308004224/t4294967305(0) o4->9c560788-da9a-41fd-952d-091d96dace11@192.168.203.13@tcp:751/0 lens 504/448 e 0 to 0 dl 1788813191 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788813180.610624:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93ef36177800 with x1875706308004224 ext(0->12) 00010000:00010000:3.0:1788813180.610631:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b65c4a36/0x1b294f297b1ecbcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c60 expref: 9 pid: 6677 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813180.610644:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b65c4a36/0x1b294f297b1ecbcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c60 expref: 9 pid: 6677 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788813180.610651:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93ef36177800 00000100:00100000:2.0:1788813180.619408:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813180.619488:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308004352 00000100:00100000:0.0:1788813180.619499:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308004352 00010000:00010000:0.0:1788813180.619539:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b65c4a36/0x1b294f297b1ecbcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c60 expref: 9 pid: 6677 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813180.619590:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:0.0:1788813180.619601:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36176d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+9:2363:x1875706308004352:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813180.619615:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788813180.619634:0:5819:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788813180.619638:0:5819:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788813180 00002000:00010000:0.0:1788813180.619640:0:5819:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788813180 00002000:00010000:0.0:1788813180.619654:0:5819:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788813180 00010000:00010000:0.0:1788813180.619661:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000b65c4a36/0x1b294f297b1ecbcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c60 expref: 9 pid: 6677 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.619675:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b65c4a36/0x1b294f297b1ecbcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c60 expref: 9 pid: 6677 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.619699:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b65c4a36/0x1b294f297b1ecbcc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c60 expref: 9 pid: 6677 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.619714:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1788813180.619718:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813180.619724:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000362407a8/0x1b294f297b1ecc19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.619734:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000362407a8/0x1b294f297b1ecc19 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.619773:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813180.620021:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36176d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+8:2363:x1875706308004352:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 421us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813180.620030:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00010000:00010000:1.0:1788813180.621164:0:8122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000362407a8/0x1b294f297b1ecc19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.621180:0:8122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000362407a8/0x1b294f297b1ecc19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.621232:0:8122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000362407a8/0x1b294f297b1ecc19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.621241:0:8122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000362407a8/0x1b294f297b1ecc19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.621250:0:8122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000362407a8/0x1b294f297b1ecc19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.621257:0:8122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fc400 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:1.0:1788813180.621262:0:8122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000362407a8/0x1b294f297b1ecc19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.621271:0:8122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000362407a8/0x1b294f297b1ecc19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.621289:0:8122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000362407a8/0x1b294f297b1ecc19 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.621297:0:8122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000362407a8/0x1b294f297b1ecc19 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813180.621437:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3639c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+7:2365:x1875706308004096:12345-192.168.203.13@tcp:1:lfs.0 Request processed in 16434us (16754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813180.621446:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:2.0:1788813180.628527:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813180.628610:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308004608 00000100:00100000:3.0:1788813180.628621:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308004608 00000100:00100000:3.0:1788813180.628674:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:3.0:1788813180.628685:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef0e7fa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+25:11374:x1875706308004608:12345-192.168.203.13@tcp:35:lfs.0 00000004:00010000:3.0:1788813180.628747:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecc0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c7c expref: 25 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788813180.629029:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1788813180.629075:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1788813180.629596:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1788813180.629656:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecc20 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813180.629673:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecbb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c52 expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813180.629695:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecc20 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813180.629729:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecbb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c52 expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813180.629744:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecbb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c52 expref: 29 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813180.629760:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3639f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5837:1875706322687616:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788813180.629862:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef20e1f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788813180.638008:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3639f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5837:1875706322687616:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788813180.638039:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecc20 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813180.638197:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813180.638272:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308004736 00000100:00100000:0.0:1788813180.638293:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308004736 00010000:00010000:0.0:1788813180.638331:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecbb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c52 expref: 30 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813180.638371:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:0.0:1788813180.638381:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1207c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+30:2366:x1875706308004736:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813180.638406:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813180.638414:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecbb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c52 expref: 30 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.638427:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecbb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c52 expref: 30 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.638449:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecbb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c52 expref: 30 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.638465:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef10b7ae00) 00010000:00010000:0.0:1788813180.638470:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecc20 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.638480:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecc20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.638488:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecc20 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.638523:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813180.638581:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1207c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+29:2366:x1875706308004736:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 200us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813180.638600:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00010000:00010000:1.0:1788813180.638683:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecc20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.638692:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecc20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788813180.638860:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788813180.639054:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1788813180.639163:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3c6ef100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1875706322687744:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788813180.639227:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813180.639266:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a1f40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813180.639431:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322687744 00000100:00100000:0.0:1788813180.639437:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322687744 00000100:00100000:0.0:1788813180.639484:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788813180.639492:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1875706322687744:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788813180.639559:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1875706322687744:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 68us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813180.639566:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788813180.639588:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813180.639702:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3c6ef100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1875706322687744:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788813180.640680:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1788813180.640750:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b01180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1875706322687872:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788813180.640830:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813180.640998:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a1f4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813180.647713:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322687872 00000100:00100000:0.0:1788813180.647728:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322687872 00000100:00100000:2.0:1788813180.647961:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788813180.647975:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5837:x1875706322687872:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788813180.648229:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5837:x1875706322687872:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 258us (7397us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788813180.648237:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788813180.648328:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b01180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1875706322687872:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788813180.648408:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1788813180.648453:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecc20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.648465:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecc20 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.648472:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecc20 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.648479:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813180.648483:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecc20 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.648504:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecc20 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.648520:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef10b7ae00) 00010000:00010000:1.0:1788813180.648523:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788813180.648528:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecc20 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.648534:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecc20 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788813180.648724:0:5837:0:(mdd_object.c:4199:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788813180.648887:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1788813180.648899:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 341035116447ns, next at 342035114216ns, rc = 0 00000001:00080000:1.0:1788813180.648906:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1788813180.648940:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef10b7ae00) 00010000:00010000:1.0:1788813180.648943:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788813180.648951:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecc0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c7c expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813180.649051:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef0e7fa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+32:11374:x1875706308004608:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 20367us (20532us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1788813180.649059:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00000020:00080000:1.0:1788813180.649063:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788813180.652388:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813180.652574:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308004864 00000100:00100000:1.0:1788813180.652585:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308004864 00000100:00100000:1.0:1788813180.652635:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 147 00000100:00100000:1.0:1788813180.652645:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1207df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+32:11374:x1875706308004864:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813180.652688:0:8565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813180.652712:0:8565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ecc27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2c83 expref: -99 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.652771:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ecc27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c83 expref: 33 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.652838:0:8565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ecc27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c83 expref: 33 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.661062:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:2.0:1788813180.661072:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788813180.661078:0:8565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fc400, rc 0) 00000100:00100000:2.0:1788813180.661167:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1207df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+33:11374:x1875706308004864:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 8519us (8783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813180.661176:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 147 00000100:00100000:2.0:1788813180.675508:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813180.682137:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308005120 00000100:00100000:1.0:1788813180.682152:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308005120 00000100:00100000:0.0:1788813180.687054:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:0.0:1788813180.687068:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+33:11374:x1875706308005120:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1788813180.687329:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+34:11374:x1875706308005120:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 263us (11830us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1788813180.687337:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:2.0:1788813180.801452:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813180.801913:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308005376 00000100:00100000:0.0:1788813180.801923:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308005376 00000100:00100000:0.0:1788813180.801990:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 148 00000100:00100000:0.0:1788813180.802000:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+34:11384:x1875706308005376:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813180.802022:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813180.802043:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecc2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2c8a expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813180.802131:0:7630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788813180.802247:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecc2e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c8a expref: 36 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.802276:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef10b7a600) 00010000:00010000:0.0:1788813180.802279:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788813180.802285:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecc2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c8a expref: 36 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.802299:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cee00, rc 0) 00000100:00100000:0.0:1788813180.802364:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+35:11384:x1875706308005376:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 365us (919us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1788813180.802372:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 148 00000100:00100000:2.0:1788813180.817407:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813180.817524:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308005504 00000100:00100000:1.0:1788813180.817535:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308005504 00000100:00100000:1.0:1788813180.817594:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 149 00000100:00100000:1.0:1788813180.817614:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+35:11384:x1875706308005504:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:1.0:1788813180.817687:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ecc3c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.817705:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ecc3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.817718:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ecc3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.817733:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ecc43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.817740:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ecc43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.817762:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ecc43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.818011:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecc4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.818020:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecc4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.818027:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecc4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788813180.818071:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecc4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.818083:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ecc3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.818089:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ecc3c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.818096:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ecc3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.818101:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fd200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813180.818106:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ecc3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.818112:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ecc3c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.818123:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:1.0:1788813180.818132:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813180.818137:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ecc3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.818144:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ecc3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.818157:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ecc43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.818162:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ecc43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.818168:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ecc43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.818173:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fd800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813180.818176:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ecc43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.818182:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ecc43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.818190:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ef19f1fc00) 00010000:00010000:1.0:1788813180.818192:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813180.818195:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ecc43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.818201:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ecc43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.818217:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecc4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.818231:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecc4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.818236:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecc4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.818241:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fca00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813180.818245:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecc4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.818251:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecc4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.818259:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:1.0:1788813180.818262:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813180.818265:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecc4a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813180.818270:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecc4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813180.818401:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+35:11384:x1875706308005504:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 789us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813180.818409:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 149 00000100:00100000:1.0:1788813180.829618:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813180.829720:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308005760 00000100:00100000:2.0:1788813180.829731:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308005760 00000100:00100000:2.0:1788813180.829806:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:2.0:1788813180.829818:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+35:11384:x1875706308005760:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788813180.830175:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+36:11384:x1875706308005760:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 359us (565us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788813180.830198:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00010000:00010000:3.0:1788813180.893101:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813180.945167:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813180.945275:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308006016 00000100:00100000:0.0:1788813180.945286:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308006016 00000100:00100000:0.0:1788813180.945354:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 150 00000100:00100000:0.0:1788813180.945365:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+36:11387:x1875706308006016:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813180.945399:0:8565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813180.945419:0:8565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecc51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2c91 expref: -99 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.945494:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecc58 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.945508:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecc58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.945520:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecc58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.945534:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecc5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.945556:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecc5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.945563:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecc5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.945671:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ecc66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.945680:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ecc66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.945686:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ecc66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813180.945695:0:8565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788813180.945820:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecc58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.945828:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecc58 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.945847:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecc58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.945854:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cf000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813180.945858:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecc58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.945866:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecc58 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.945889:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:0.0:1788813180.945892:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813180.945897:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecc58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.945902:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecc58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.945916:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecc5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.945922:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecc5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.945927:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecc5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.945932:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cfe00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813180.945934:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecc5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.945940:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecc5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.945947:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ef1a079700) 00010000:00010000:0.0:1788813180.945949:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813180.945952:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecc5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.945957:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecc5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.946008:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecc51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c91 expref: 39 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.946022:0:8565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ecc66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c91 expref: 38 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813180.946028:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:0.0:1788813180.946030:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813180.946033:0:8565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190ce600, rc 0) 00000100:00100000:0.0:1788813180.946097:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+38:11387:x1875706308006016:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 734us (941us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1788813180.946104:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 150 00000100:00100000:3.0:1788813180.948904:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813180.948996:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308006144 00000100:00100000:2.0:1788813180.949006:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308006144 00000100:00100000:2.0:1788813180.949057:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 151 00000100:00100000:2.0:1788813180.949067:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3639d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+38:11387:x1875706308006144:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:2.0:1788813180.949131:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecc74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.949147:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecc74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.949159:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecc74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.949184:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecc74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.949191:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecc74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.949197:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecc74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.949201:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813180.949206:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecc74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.949212:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecc74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.949241:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:2.0:1788813180.949244:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813180.949250:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecc74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813180.949255:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecc74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813180.949330:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3639d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+38:11387:x1875706308006144:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 264us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813180.949338:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 151 00000100:00100000:1.0:1788813180.954656:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813180.954752:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308006400 00000100:00100000:2.0:1788813180.954762:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308006400 00000100:00100000:2.0:1788813180.954854:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:2.0:1788813180.954865:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+38:11387:x1875706308006400:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788813180.955095:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+39:11387:x1875706308006400:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 231us (447us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788813180.955102:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:1.0:1788813181.361325:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813181.362372:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308006656 00000100:00100000:2.0:1788813181.362384:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308006656 00000100:00100000:2.0:1788813181.362908:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 152 00000100:00100000:2.0:1788813181.362920:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+39:11418:x1875706308006656:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:2.0:1788813181.362944:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813181.362965:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecc7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2c98 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813181.363063:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecc82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813181.363093:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecc82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813181.363106:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecc82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813181.363119:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788813181.363249:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecc7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c98 expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813181.363267:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecc82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c98 expref: 41 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813181.363276:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:2.0:1788813181.363279:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813181.363282:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619c00, rc 0) 00000100:00100000:2.0:1788813181.363741:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+41:11418:x1875706308006656:12345-192.168.203.13@tcp:101:cat.0 Request processed in 822us (2424us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788813181.363749:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 152 00000100:00100000:3.0:1788813181.370503:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813181.371480:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813181.371941:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308006912 00000100:00100000:2.0:1788813181.371951:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308006912 00000100:00100000:2.0:1788813181.372012:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:2.0:1788813181.372024:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3639ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+41:11418:x1875706308006912:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:2.0:1788813181.372265:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3639ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+42:11418:x1875706308006912:12345-192.168.203.13@tcp:35:cat.0 Request processed in 242us (1770us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788813181.372273:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:0.0:1788813181.374823:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308007040 00000100:00100000:0.0:1788813181.374847:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308007040 00000100:00100000:0.0:1788813181.374931:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:0.0:1788813181.374942:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef121e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+42:2365:x1875706308007040:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813181.374958:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813181.374985:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecc82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c98 expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.375005:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:0.0:1788813181.375010:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813181.375071:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef121e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+41:2365:x1875706308007040:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 131us (3594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813181.375078:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:1.0:1788813181.437706:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813181.437940:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308007296 00000100:00100000:0.0:1788813181.437950:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308007296 00000100:00100000:0.0:1788813181.438009:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 153 00000100:00100000:0.0:1788813181.438019:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+41:11424:x1875706308007296:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:0.0:1788813181.438040:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813181.438042:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788813181.438067:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecbe8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c6e expref: 41 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.438084:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:0.0:1788813181.438089:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813181.438102:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecc90 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2c9f expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.438193:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecc97 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.438206:0:7630:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ecc66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c91 expref: 41 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.438220:0:7630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecc97 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.438250:0:7630:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ecc66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c91 expref: 41 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.438262:0:7630:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ecc66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c91 expref: 41 pid: 8565 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813181.438295:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef363d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7630:1875706322688000:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788813181.438397:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee066bb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813181.444106:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813181.444212:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308007424 00000100:00100000:3.0:1788813181.444222:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308007424 00010000:00010000:3.0:1788813181.444262:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ecc66 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c91 expref: 42 pid: 8565 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813181.444307:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:3.0:1788813181.444316:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+42:2363:x1875706308007424:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813181.444330:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813181.444337:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ecc66 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c91 expref: 42 pid: 8565 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.444351:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ecc66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c91 expref: 42 pid: 8565 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.444380:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:3.0:1788813181.444395:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecc97 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.444405:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecc97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.444413:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecc97 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.444433:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813181.444478:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+42:2363:x1875706308007424:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 163us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813181.444486:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 65 00010000:00010000:0.0:1788813181.444880:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ecc66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c91 expref: 41 pid: 8565 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813181.444898:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef363d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7630:1875706322688000:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788813181.444917:0:7630:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecc97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.444926:0:7630:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecc97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.444932:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecc97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813181.444950:0:7630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788813181.445089:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecc90 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c9f expref: 42 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.445104:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecc97 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c9f expref: 41 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.445110:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:0.0:1788813181.445113:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788813181.445115:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cfe00, rc 0) 00000100:00100000:0.0:1788813181.445146:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+41:11424:x1875706308007296:12345-192.168.203.13@tcp:101:dd.0 Request processed in 7129us (7448us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788813181.445163:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 153 00000100:00100000:1.0:1788813181.448015:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813181.448161:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308007680 00000100:00100000:0.0:1788813181.448172:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308007680 00000100:00100000:0.0:1788813181.448231:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 154 00000100:00100000:0.0:1788813181.448241:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+41:11424:x1875706308007680:12345-192.168.203.13@tcp:36:dd.0 00010000:00010000:0.0:1788813181.448696:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecca5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.448713:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecca5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.448726:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecca5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788813181.448921:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1788813181.448955:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6224db3 reply state 0000000090629db4 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecca5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813181.448964:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788813181.449062:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+44:11424:x1875706308007680:12345-192.168.203.13@tcp:36:dd.0 Request processed in 822us (1055us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788813181.449070:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 154 00000020:00080000:0.0:1788813181.449075:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788813181.450830:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecca5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813181.450854:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecca5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813181.450861:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecca5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813181.450868:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cf000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813181.450872:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecca5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813181.450878:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecca5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813181.450894:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:1.0:1788813181.450897:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813181.450901:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecca5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813181.450907:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecca5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813181.598146:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788813181.598167:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef363d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322688128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813181.598232:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813181.598972:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322688128 00000100:00100000:2.0:1788813181.599005:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322688128 00000100:00100000:2.0:1788813181.599052:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788813181.599061:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef363d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875706322688128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813181.599082:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813181.599129:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef363d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875706322688128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813181.599135:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788813181.599366:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813181.599378:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322688256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813181.599424:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813181.600057:0:10074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322688256 00000100:00100000:0.0:1788813181.600065:0:10074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322688256 00000100:00100000:0.0:1788813181.600116:0:10074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788813181.600133:0:10074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3639f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322688256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788813181.600161:0:10074:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813181.600201:0:10074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3639f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322688256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813181.600207:0:10074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788813181.600249:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322688256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813181.600280:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef363d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322688128:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788813181.600340:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813181.600729:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322688640:0@lo:400:kworker.0 00000100:00100000:2.0:1788813181.600729:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875706322688512:0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.600805:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322688384:0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.601045:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813181.602478:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813181.602628:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813181.602638:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322688768:0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.602650:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322688640 00000100:00100000:0.0:1788813181.602657:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322688640 00000100:00100000:3.0:1788813181.602680:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788813181.602681:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813181.602714:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322688768 00000100:00100000:3.0:1788813181.602715:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813181.602717:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322688768 00000100:00100000:0.0:1788813181.602739:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322688512 00000100:00100000:0.0:1788813181.602742:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322688512 00000100:00100000:3.0:1788813181.602750:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788813181.602757:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788813181.602763:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3639d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875706322688768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.602828:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3639d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875706322688768:12345-0@lo:400:kworker.0 Request processed in 65us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813181.602847:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788813181.602863:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788813181.602869:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875706322688512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.602901:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875706322688512:12345-0@lo:400:kworker.0 Request processed in 32us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813181.602906:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:0.0:1788813181.602932:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813181.602962:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875706322688512:0@lo:400:kworker.0 00000100:00100000:3.0:1788813181.602965:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3639c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322688640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813181.603001:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322688768:0@lo:400:kworker.0 00000100:00100000:3.0:1788813181.603122:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3639c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322688640:12345-0@lo:400:kworker.0 Request processed in 364us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813181.603135:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788813181.604181:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322688384 00000100:00100000:2.0:1788813181.604192:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322688384 00000100:00100000:2.0:1788813181.604248:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788813181.604257:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3299:x1875706322688384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813181.604807:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3299:x1875706322688384:12345-0@lo:400:kworker.0 Request processed in 526us (3735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813181.604816:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788813181.605015:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322688640:0@lo:400:kworker.0 00000100:00100000:3.0:1788813181.605318:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322688384:0@lo:400:kworker.0 00000100:00100000:1.0:1788813181.658709:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813181.659114:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308007808 00000100:00100000:0.0:1788813181.659125:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308007808 00000100:00100000:0.0:1788813181.659190:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 155 00000100:00100000:0.0:1788813181.659200:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+43:11438:x1875706308007808:12345-192.168.203.13@tcp:101:stat.0 00010000:00010000:0.0:1788813181.659223:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813181.659243:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1eccac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2ca6 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.659308:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eccb3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.659322:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eccb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.659335:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eccb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.659349:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1eccba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.659356:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1eccba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.659362:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1eccba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.659596:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce400/0x1b294f297b1eccc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.659608:0:7630:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecc97 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c9f expref: 44 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.659616:0:7630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce400/0x1b294f297b1eccc1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.659647:0:7630:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecc97 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c9f expref: 44 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.659661:0:7630:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecc97 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c9f expref: 44 pid: 7630 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813181.659674:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef363d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7630:1875706322688896:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788813181.659843:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee066bb900 going to sleep for 11 seconds 00000100:00100000:2.0:1788813181.677608:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813181.677736:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308008064 00000100:00100000:1.0:1788813181.677745:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308008064 00000100:00100000:1.0:1788813181.677822:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:1.0:1788813181.677842:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+45:5597:x1875706308008064:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788813181.678184:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+46:5597:x1875706308008064:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 351us (585us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1788813181.678206:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:0.0:1788813181.679118:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef363d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7630:1875706322688896:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788813181.679147:0:7630:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce400/0x1b294f297b1eccc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813181.681271:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813181.681358:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308008192 00000100:00100000:0.0:1788813181.681366:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308008192 00010000:00010000:0.0:1788813181.681419:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecc97 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c9f expref: 46 pid: 7630 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813181.681461:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:0.0:1788813181.681483:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+46:2365:x1875706308008192:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813181.681497:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813181.681505:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecc97 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c9f expref: 46 pid: 7630 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.681518:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecc97 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c9f expref: 46 pid: 7630 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.681541:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecc97 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c9f expref: 46 pid: 7630 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.681559:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:0.0:1788813181.681564:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce400/0x1b294f297b1eccc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.681572:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce400/0x1b294f297b1eccc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.681580:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce400/0x1b294f297b1eccc1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.681613:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813181.681669:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+45:2365:x1875706308008192:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 188us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813181.681676:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 66 00010000:00010000:1.0:1788813181.682253:0:7630:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce400/0x1b294f297b1eccc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813181.682264:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce400/0x1b294f297b1eccc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813181.682306:0:7630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788813181.682311:0:7630:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813181.682333:0:7630:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce400/0x1b294f297b1eccc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813181.682347:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce400/0x1b294f297b1eccc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813181.682357:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eccb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813181.682364:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eccb3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813181.682370:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eccb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813181.682375:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190ce600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813181.682379:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eccb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813181.682399:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eccb3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813181.682422:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:1.0:1788813181.682425:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813181.682430:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eccb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813181.682435:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1eccb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813181.682447:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1eccba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813181.682453:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1eccba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813181.682459:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1eccba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813181.682464:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cec00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813181.682466:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1eccba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813181.682472:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1eccba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813181.682479:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ef1a079700) 00010000:00010000:1.0:1788813181.682481:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813181.682484:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1eccba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813181.682490:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1eccba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813181.682544:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1eccac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ca6 expref: 45 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813181.682558:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce400/0x1b294f297b1eccc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ca6 expref: 44 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813181.682564:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:1.0:1788813181.682567:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813181.682569:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190ce400, rc 0) 00000100:00100000:1.0:1788813181.682615:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+44:11438:x1875706308007808:12345-192.168.203.13@tcp:101:stat.0 Request processed in 23417us (23916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813181.682623:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 155 00000100:00100000:1.0:1788813181.751085:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813181.751191:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308008448 00000100:00100000:0.0:1788813181.751201:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308008448 00000100:00100000:0.0:1788813181.751315:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 156 00000100:00100000:0.0:1788813181.751327:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+44:11444:x1875706308008448:12345-192.168.203.13@tcp:36:truncate.0 00010000:00010000:0.0:1788813181.751421:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813181.751457:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce400/0x1b294f297b1eccc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ca6 expref: 44 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.751477:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:0.0:1788813181.751482:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813181.751684:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1eccc8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.751699:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1eccc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.751709:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1eccc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788813181.751761:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1788813181.751844:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d26af46 reply state 00000000746b0713 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1eccc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813181.751854:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788813181.751947:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+46:11444:x1875706308008448:12345-192.168.203.13@tcp:36:truncate.0 Request processed in 622us (871us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788813181.751955:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 156 00000020:00080000:0.0:1788813181.751960:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788813181.765082:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1eccc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813181.765100:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1eccc8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813181.765109:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1eccc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813181.765116:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cfe00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813181.765120:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1eccc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813181.765147:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1eccc8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813181.765175:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:2.0:1788813181.765178:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813181.765184:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1eccc8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813181.765191:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1eccc8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813181.923127:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813181.945254:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813181.945612:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308008576 00000100:00100000:3.0:1788813181.945626:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308008576 00000100:00100000:3.0:1788813181.945709:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 157 00000100:00100000:3.0:1788813181.945720:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+45:11458:x1875706308008576:12345-192.168.203.13@tcp:101:stat.0 00010000:00010000:3.0:1788813181.945752:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813181.945834:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecccf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2cad expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.945923:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1eccd6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.945942:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1eccd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.945955:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1eccd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.945975:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1eccdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.945982:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1eccdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.945989:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1eccdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.946093:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ecce4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.946117:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ecce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.946125:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ecce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813181.946170:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788813181.946175:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813181.946198:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ecce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.946211:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ecce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.946220:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1eccd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.946227:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1eccd6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.946235:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1eccd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.946242:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813181.946247:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1eccd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.946256:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1eccd6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.946269:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:3.0:1788813181.946279:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813181.946285:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1eccd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.946293:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1eccd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.946311:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1eccdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.946329:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1eccdd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.946337:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1eccdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.946343:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813181.946347:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1eccdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.946353:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1eccdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.946361:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ef077b4c00) 00010000:00010000:3.0:1788813181.946364:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813181.946367:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1eccdd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.946373:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1eccdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.946419:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecccf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cad expref: 47 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.946447:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ecce4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cad expref: 46 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813181.946455:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:3.0:1788813181.946457:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813181.946460:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef421e8c00, rc 0) 00000100:00100000:3.0:1788813181.946545:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+46:11458:x1875706308008576:12345-192.168.203.13@tcp:101:stat.0 Request processed in 827us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813181.946555:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 157 00000100:00100000:3.0:1788813182.059408:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813182.060259:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308008832 00000100:00100000:1.0:1788813182.060277:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308008832 00000100:00100000:1.0:1788813182.060398:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 158 00000100:00100000:1.0:1788813182.060411:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+46:11468:x1875706308008832:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813182.060439:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813182.060465:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ecceb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2cb4 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788813182.060584:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1788813182.061380:0:7630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788813182.063063:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ecceb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cb4 expref: 48 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.063722:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef10b7a600) 00010000:00010000:1.0:1788813182.063726:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788813182.063735:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ecceb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cb4 expref: 48 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.063758:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fdc00, rc 0) 00000100:00100000:1.0:1788813182.063931:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+47:11468:x1875706308008832:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 3523us (4546us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1788813182.063942:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 158 00000100:00100000:1.0:1788813182.070639:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813182.071105:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308009088 00000100:00100000:2.0:1788813182.071122:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308009088 00000100:00100000:2.0:1788813182.071197:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:2.0:1788813182.071217:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef0e7fbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+47:11468:x1875706308009088:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788813182.071537:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef0e7fbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+48:11468:x1875706308009088:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 321us (910us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788813182.071545:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:2.0:1788813182.143017:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813182.143199:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308009344 00000100:00100000:0.0:1788813182.143214:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308009344 00000100:00100000:0.0:1788813182.143293:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 159 00000100:00100000:0.0:1788813182.143305:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+48:11474:x1875706308009344:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788813182.143359:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813182.143398:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce400/0x1b294f297b1eccf9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2cbb expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813182.143561:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce000/0x1b294f297b1ecd00 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813182.143581:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ecce4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cad expref: 49 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813182.143592:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce000/0x1b294f297b1ecd00 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813182.143636:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ecce4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cad expref: 49 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813182.143652:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ecce4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cad expref: 49 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813182.143668:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef363d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875706322689024:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788813182.143943:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee066bbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813182.148515:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813182.148668:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308009472 00000100:00100000:1.0:1788813182.148680:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308009472 00010000:00010000:1.0:1788813182.149443:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ecce4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cad expref: 50 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813182.149606:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:1.0:1788813182.149621:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+50:2365:x1875706308009472:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813182.149643:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813182.149651:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ecce4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cad expref: 50 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.149668:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ecce4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cad expref: 50 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.149698:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:1.0:1788813182.149740:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce000/0x1b294f297b1ecd00 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.149753:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce000/0x1b294f297b1ecd00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.149762:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce000/0x1b294f297b1ecd00 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.149823:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813182.149892:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+50:2365:x1875706308009472:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 274us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813182.149900:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 67 00010000:00010000:0.0:1788813182.150475:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ecce4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cad expref: 49 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813182.150500:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef363d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875706322689024:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788813182.150527:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce000/0x1b294f297b1ecd00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813182.150550:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce000/0x1b294f297b1ecd00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813182.150557:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce000/0x1b294f297b1ecd00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813182.150581:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788813182.150856:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce400/0x1b294f297b1eccf9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cbb expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813182.150875:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce000/0x1b294f297b1ecd00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cbb expref: 49 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813182.150884:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:0.0:1788813182.150887:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788813182.150890:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190ce000, rc 0) 00000100:00100000:0.0:1788813182.150939:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+49:11474:x1875706308009344:12345-192.168.203.13@tcp:101:bash.0 Request processed in 7637us (7938us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1788813182.150948:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 159 00000100:00100000:3.0:1788813182.154352:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813182.154461:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308009728 00000100:00100000:2.0:1788813182.154475:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308009728 00000100:00100000:2.0:1788813182.154550:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 160 00000100:00100000:2.0:1788813182.154562:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+49:11474:x1875706308009728:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:2.0:1788813182.154976:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ecd0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.155000:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ecd0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.155038:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ecd0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788813182.155103:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1788813182.155131:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000885a623a reply state 0000000087224dc3 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ecd0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813182.155142:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788813182.155284:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+52:11474:x1875706308009728:12345-192.168.203.13@tcp:36:bash.0 Request processed in 723us (944us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788813182.155293:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 160 00000020:00080000:2.0:1788813182.155300:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788813182.160380:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ecd0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.160411:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ecd0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.160421:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ecd0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.160429:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618400 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813182.160434:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ecd0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.160443:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ecd0e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.160466:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:1.0:1788813182.160470:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813182.160478:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ecd0e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.160511:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618400/0x1b294f297b1ecd0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813182.163150:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813182.165587:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308009856 00000100:00100000:1.0:1788813182.165609:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308009856 00000100:00100000:1.0:1788813182.165699:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 161 00000100:00100000:1.0:1788813182.165712:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+51:11474:x1875706308009856:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788813182.165743:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813182.165770:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ecd15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2cc2 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.165937:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ecd1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.165955:0:7630:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce000/0x1b294f297b1ecd00 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cbb expref: 52 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.165965:0:7630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ecd1c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.166010:0:7630:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce000/0x1b294f297b1ecd00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cbb expref: 52 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.166025:0:7630:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce000/0x1b294f297b1ecd00 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cbb expref: 52 pid: 5835 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813182.166041:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b00000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7630:1875706322689152:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788813182.166157:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a1f4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813182.170692:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b00000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7630:1875706322689152:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788813182.170736:0:7630:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ecd1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813182.180015:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813182.180346:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308009984 00000100:00100000:0.0:1788813182.180360:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308009984 00010000:00010000:0.0:1788813182.180431:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce000/0x1b294f297b1ecd00 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cbb expref: 53 pid: 5835 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813182.180492:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:0.0:1788813182.180504:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+53:2366:x1875706308009984:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813182.180526:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813182.180545:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce000/0x1b294f297b1ecd00 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cbb expref: 53 pid: 5835 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813182.180562:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce000/0x1b294f297b1ecd00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cbb expref: 53 pid: 5835 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813182.180594:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce000/0x1b294f297b1ecd00 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cbb expref: 53 pid: 5835 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813182.180617:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:0.0:1788813182.180624:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ecd1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813182.180636:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ecd1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813182.180644:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ecd1c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813182.180693:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813182.180765:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+52:2366:x1875706308009984:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 263us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813182.180773:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 68 00010000:00010000:1.0:1788813182.181928:0:7630:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ecd1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.181946:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ecd1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813182.182205:0:7630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788813182.182211:0:7630:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813182.182239:0:7630:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ecd1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.182289:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ecd15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cc2 expref: 52 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.182313:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ecd1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cc2 expref: 51 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.182322:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:1.0:1788813182.182325:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813182.182329:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fd800, rc 0) 00000100:00100000:1.0:1788813182.182417:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+51:11474:x1875706308009856:12345-192.168.203.13@tcp:101:bash.0 Request processed in 16708us (19283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813182.182428:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 161 00000100:00100000:1.0:1788813182.188470:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813182.188594:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308010240 00000100:00100000:2.0:1788813182.188608:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308010240 00000100:00100000:1.0:1788813182.190835:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:1.0:1788813182.190875:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+51:11474:x1875706308010240:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:1.0:1788813182.191380:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+52:11474:x1875706308010240:12345-192.168.203.13@tcp:35:bash.0 Request processed in 526us (2921us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1788813182.191404:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:0.0:1788813182.281641:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813182.281946:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308010496 00000100:00100000:2.0:1788813182.282059:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308010496 00000100:00100000:2.0:1788813182.282259:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 162 00000100:00100000:2.0:1788813182.282272:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef363d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+52:11484:x1875706308010496:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813182.282305:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813182.282332:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecd23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2cc9 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813182.282598:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788813182.282760:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecd23 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cc9 expref: 54 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.283186:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef10b7a600) 00010000:00010000:2.0:1788813182.283189:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813182.283197:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecd23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cc9 expref: 54 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.283215:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619200, rc 0) 00000100:00100000:2.0:1788813182.283412:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef363d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+53:11484:x1875706308010496:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1142us (1786us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1788813182.283429:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 162 00000100:00100000:0.0:1788813182.295539:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813182.295642:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308010624 00000100:00100000:2.0:1788813182.295653:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308010624 00000100:00100000:2.0:1788813182.295731:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 163 00000100:00100000:2.0:1788813182.295743:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef363d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+53:11484:x1875706308010624:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:2.0:1788813182.296224:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecd31 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296248:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecd31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296262:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecd31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296280:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecd38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296288:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecd38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296318:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecd38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296436:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecd3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296445:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecd3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296453:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecd3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788813182.296508:0:8565:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecd3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296523:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecd31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296531:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecd31 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296537:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecd31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296543:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813182.296548:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecd31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296555:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecd31 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296568:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:2.0:1788813182.296577:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813182.296584:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecd31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296590:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecd31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296606:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecd38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296612:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecd38 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296618:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecd38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296624:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619c00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813182.296626:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecd38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296633:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecd38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296640:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ef10b7a400) 00010000:00010000:2.0:1788813182.296643:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813182.296646:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecd38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296652:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecd38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296666:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecd3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296677:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecd3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296683:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecd3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296689:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619a00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813182.296692:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecd3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296698:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecd3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296707:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:2.0:1788813182.296709:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813182.296713:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecd3f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.296718:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecd3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813182.298390:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef363d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+53:11484:x1875706308010624:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 2628us (2845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813182.298407:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 163 00000100:00100000:0.0:1788813182.300296:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813182.300437:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308010880 00000100:00100000:1.0:1788813182.300450:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308010880 00000100:00100000:1.0:1788813182.300517:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:1.0:1788813182.300529:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef363d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+53:11484:x1875706308010880:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1788813182.300902:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef363d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+54:11484:x1875706308010880:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 373us (617us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788813182.300910:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:0.0:1788813182.346051:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813182.349374:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308011136 00000100:00100000:1.0:1788813182.349405:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308011136 00000100:00100000:1.0:1788813182.349509:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 164 00000100:00100000:1.0:1788813182.349523:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef363d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+54:11487:x1875706308011136:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813182.349555:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813182.349583:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ecd46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2cd0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.349683:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecd4d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.349702:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecd4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.349717:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecd4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.349735:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecd54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.349742:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecd54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.349777:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecd54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.351624:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ecd5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.351646:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ecd5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.351661:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ecd5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813182.351675:0:7630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788813182.352203:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecd4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.352214:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecd4d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.352222:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecd4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.352229:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fca00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813182.352234:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecd4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.352243:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecd4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.352259:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:1.0:1788813182.352262:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813182.352284:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecd4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.352290:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecd4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.352310:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecd54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.352318:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecd54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.352324:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecd54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.352329:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fc800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813182.352331:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecd54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.352337:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecd54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.352345:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ef19f1fc00) 00010000:00010000:1.0:1788813182.352347:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813182.352351:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecd54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.352356:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecd54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.352438:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ecd46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cd0 expref: 57 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.352467:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ecd5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cd0 expref: 56 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.352475:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:1.0:1788813182.352478:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813182.352482:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fd000, rc 0) 00000100:00100000:1.0:1788813182.352656:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef363d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+56:11487:x1875706308011136:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 3135us (6620us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1788813182.352666:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 164 00000100:00100000:0.0:1788813182.358363:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813182.358480:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308011264 00000100:00100000:2.0:1788813182.358493:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308011264 00000100:00100000:2.0:1788813182.358571:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 165 00000100:00100000:2.0:1788813182.358583:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef363d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+56:11487:x1875706308011264:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:2.0:1788813182.358676:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecd69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.358710:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecd69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.358725:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecd69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.358764:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecd69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.358773:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecd69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.358826:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecd69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.358834:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619a00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813182.358840:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecd69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.358850:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecd69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.358863:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:2.0:1788813182.358867:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813182.358873:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecd69 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.358880:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecd69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813182.359281:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef363d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+56:11487:x1875706308011264:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 697us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813182.359301:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 165 00000100:00100000:1.0:1788813182.359578:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813182.359664:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308011392 00000100:00100000:3.0:1788813182.359671:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308011392 00000100:00100000:3.0:1788813182.359723:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:3.0:1788813182.359733:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+56:2365:x1875706308011392:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813182.359746:0:8439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813182.359768:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ecd5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cd0 expref: 56 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.359806:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:3.0:1788813182.359811:0:8439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813182.359850:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+55:2365:x1875706308011392:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 119us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813182.359877:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:0.0:1788813182.362574:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813182.362766:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308011648 00000100:00100000:1.0:1788813182.362826:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308011648 00000100:00100000:1.0:1788813182.364202:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:1.0:1788813182.364226:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef363d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+55:11487:x1875706308011648:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1788813182.364577:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef363d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+56:11487:x1875706308011648:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 362us (2018us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788813182.364585:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:0.0:1788813182.508248:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813182.508698:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308011904 00000100:00100000:2.0:1788813182.508712:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308011904 00000100:00100000:2.0:1788813182.508838:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 166 00000100:00100000:2.0:1788813182.508850:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3696e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+56:11505:x1875706308011904:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:2.0:1788813182.508884:0:8565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813182.508912:0:8565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecd70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2cd7 expref: -99 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.509041:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecd77 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.509058:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecd77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.509073:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecd77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813182.509086:0:8565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788813182.509250:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecd70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cd7 expref: 59 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.509272:0:8565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecd77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cd7 expref: 58 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.509281:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:2.0:1788813182.509285:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788813182.509289:0:8565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619c00, rc 0) 00000100:00100000:2.0:1788813182.509392:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3696e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+58:11505:x1875706308011904:12345-192.168.203.13@tcp:101:cat.0 Request processed in 544us (1159us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788813182.509400:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 166 00000100:00100000:0.0:1788813182.532163:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813182.532367:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308012032 00000100:00100000:1.0:1788813182.532389:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308012032 00000100:00100000:1.0:1788813182.532470:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 167 00000100:00100000:1.0:1788813182.532484:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+58:11506:x1875706308012032:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813182.532517:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813182.532543:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecd85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2cde expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.532779:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecd8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.532904:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecd8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.532919:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecd8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813182.532967:0:7630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788813182.532971:0:7630:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813182.532993:0:7630:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecd8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.533025:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ecd85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cde expref: 60 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.533047:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecd8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cde expref: 59 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.533056:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:1.0:1788813182.533060:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813182.533064:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fca00, rc 0) 00000100:00100000:1.0:1788813182.533202:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+59:11506:x1875706308012032:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 721us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813182.533211:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 167 00000100:00100000:0.0:1788813182.541321:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813182.541486:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308012416 00000100:00100000:1.0:1788813182.541500:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308012416 00000100:00100000:1.0:1788813182.542310:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:1.0:1788813182.542327:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+59:11506:x1875706308012416:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1788813182.545611:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+60:11506:x1875706308012416:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 3265us (4278us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1788813182.545629:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:0.0:1788813182.548442:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813182.548570:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308012544 00000100:00100000:1.0:1788813182.548582:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308012544 00000100:00100000:1.0:1788813182.548705:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:1.0:1788813182.548718:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1207c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+60:11506:x1875706308012544:12345-192.168.203.13@tcp:103:lfs.0 00010000:00010000:1.0:1788813182.548738:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788813182.548769:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ecd1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cc2 expref: 60 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.548838:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecd77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cd7 expref: 59 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.548853:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ecc27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c83 expref: 58 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.548865:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:1.0:1788813182.548879:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813182.548949:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1207c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+57:11506:x1875706308012544:12345-192.168.203.13@tcp:103:lfs.0 Request processed in 234us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813182.548957:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:0.0:1788813182.550907:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813182.550995:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308012672 00000100:00100000:3.0:1788813182.551007:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308012672 00000100:00100000:3.0:1788813182.551079:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 168 00000100:00100000:3.0:1788813182.551091:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+57:11506:x1875706308012672:12345-192.168.203.13@tcp:58:lfs.0 00010000:00010000:3.0:1788813182.551226:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ecd93 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.551244:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ecd93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.551257:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ecd93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788813182.551522:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788813182.551612:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+57:11506:x1875706308012672:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 523us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813182.551621:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 168 00000100:00100000:0.0:1788813182.569817:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813182.569946:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308012800 00000100:00100000:3.0:1788813182.569960:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308012800 00000100:00100000:3.0:1788813182.570041:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 169 00000100:00100000:3.0:1788813182.570065:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3e33ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+57:11508:x1875706308012800:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813182.570095:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813182.570126:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ecd9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2ce5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570221:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ecda1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570258:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ecda1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570273:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ecda1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570290:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecda8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570297:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecda8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570302:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecda8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570417:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ecdaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570426:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ecdaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570434:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ecdaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813182.570479:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788813182.570485:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813182.570508:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ecdaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570522:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ecdaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570541:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ecda1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570548:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ecda1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570556:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ecda1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570562:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef421e8c00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813182.570567:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ecda1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570575:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ecda1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570589:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:3.0:1788813182.570593:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813182.570600:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ecda1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570608:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ecda1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570623:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecda8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570630:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecda8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570636:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecda8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570648:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813182.570651:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecda8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570659:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecda8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570667:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ef077b4800) 00010000:00010000:3.0:1788813182.570669:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813182.570672:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecda8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570678:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecda8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570716:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ecd9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ce5 expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570733:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ecdaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ce5 expref: 58 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.570740:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:3.0:1788813182.570742:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788813182.570745:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164e000, rc 0) 00000100:00100000:3.0:1788813182.571213:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3e33ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+58:11508:x1875706308012800:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1150us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813182.571222:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 169 00000001:00080000:2.0:1788813182.708325:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967447 is committed 00000001:00080000:2.0:1788813182.708392:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000004:00080000:2.0:1788813182.708416:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788813182.708442:0:5856:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93ef2a1f40c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788813182.708449:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ef354cc300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93ef2a1f4000 00000020:00080000:2.0:1788813182.708452:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ef354ccf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93ef36960800 00000020:00080000:2.0:1788813182.708662:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788813182.708929:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788813182.708954:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36160700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322689280:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788813182.709051:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813182.709148:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322689280 00000100:00100000:2.0:1788813182.709158:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322689280 00000100:00100000:2.0:1788813182.709229:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788813182.709239:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3639ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3299:x1875706322689280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788813182.709270:0:6676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:2.0:1788813182.709312:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f1f7c, atime: 0x6a9f1f7c, ctime: 0x6a9f1f7c, blocks: 0x1 00010000:00010000:2.0:1788813182.709321:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6b44bf6/0x1b294f297b1ecdb6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.709341:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=343s v=(0 0) 00010000:00010000:2.0:1788813182.709346:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813182.709353:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6b44bf6/0x1b294f297b1ecdb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788813182.709807:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788813182.710711:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6b44bf6/0x1b294f297b1ecdb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.710733:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6b44bf6/0x1b294f297b1ecdb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.710743:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6b44bf6/0x1b294f297b1ecdb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.710764:0:6676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788813182.712826:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3639ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3299:x1875706322689280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3578us (3765us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788813182.712840:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1788813182.712897:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813182.712907:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6b44bf6/0x1b294f297b1ecdb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.712921:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619a00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:2.0:1788813182.712927:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6b44bf6/0x1b294f297b1ecdb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.712939:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6b44bf6/0x1b294f297b1ecdb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.712965:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6b44bf6/0x1b294f297b1ecdb6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.712982:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6b44bf6/0x1b294f297b1ecdb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.713006:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813182.713008:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813182.713009:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788813182.713057:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ef36160700/2, rc 0, transno 4294967307 00000100:00100000:2.0:1788813182.713065:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36160700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322689280:0@lo:6:osp-syn-0-0.0 00000040:00080000:3.0:1788813182.751614:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788813182.751642:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788813182.751689:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1788813182.751696:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788813182.753052:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef012ac700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1875706322689408:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788813182.753519:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2253a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788813182.760606:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef012ac700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1875706322689408:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788813182.761086:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813182.762860:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308012928 00000100:00100000:1.0:1788813182.762885:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308012928 00000100:00100000:1.0:1788813182.762977:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 170 00000100:00100000:1.0:1788813182.763005:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+16:11519:x1875706308012928:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788813182.763046:0:5835:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788813182.763633:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+16:11519:x1875706308012928:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 627us (2546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813182.763644:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 170 00000100:00100000:1.0:1788813182.767988:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813182.768071:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308013056 00000100:00100000:2.0:1788813182.768084:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308013056 00000100:00100000:2.0:1788813182.768166:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 171 00000100:00100000:2.0:1788813182.768177:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+16:11519:x1875706308013056:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788813182.768271:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecdbd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768292:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecdbd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768306:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecdbd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768322:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecdc4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768328:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768340:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768395:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecdcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768405:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecdcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768412:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecdcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813182.768457:0:8565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788813182.768462:0:8565:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788813182.768476:0:8565:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecdcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768498:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecdbd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768505:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecdbd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768511:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecdbd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768517:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619a00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813182.768522:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecdbd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768529:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecdbd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768542:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ef077b4200) 00010000:00010000:2.0:1788813182.768551:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813182.768558:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecdbd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768564:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecdbd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768578:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768584:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecdc4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768589:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecdc4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768594:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813182.768597:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecdc4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768603:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecdc4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768609:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff93ef10b7a400) 00010000:00010000:2.0:1788813182.768612:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813182.768615:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecdc4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768620:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ecdc4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768635:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecdcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768645:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecdcb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768651:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecdcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768657:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813182.768661:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecdcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768666:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecdcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768673:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:2.0:1788813182.768675:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813182.768678:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecdcb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.768683:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecdcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813182.768769:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+16:11519:x1875706308013056:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 593us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813182.768778:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 171 00000100:00100000:1.0:1788813182.772906:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813182.773712:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308013312 00000100:00100000:3.0:1788813182.773727:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308013312 00000100:00100000:3.0:1788813182.773838:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 172 00000100:00100000:3.0:1788813182.773851:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+16:11519:x1875706308013312:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813182.773878:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813182.773906:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecdd2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2cec expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.774040:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ecdd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.774058:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ecdd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.774073:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ecdd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813182.774087:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788813182.774345:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ecdd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.774355:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ecdd9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.774374:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ecdd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.774391:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813182.774396:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ecdd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.774406:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ecdd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.774421:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:3.0:1788813182.774424:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788813182.774431:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ecdd9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.774438:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ecdd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.774489:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecdd2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cec expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.774500:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ef077b4200) 00010000:00010000:3.0:1788813182.774503:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813182.774507:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecdd2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cec expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.774518:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164e600, rc 0) 00000100:00100000:3.0:1788813182.774600:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+17:11519:x1875706308013312:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 751us (1708us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1788813182.774618:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 172 00000100:00100000:1.0:1788813182.782451:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813182.782599:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308013440 00000100:00100000:3.0:1788813182.782674:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308013440 00000100:00100000:3.0:1788813182.783079:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 173 00000100:00100000:3.0:1788813182.783092:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+17:11519:x1875706308013440:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788813182.783139:0:5836:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788813182.783326:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+17:11519:x1875706308013440:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 237us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813182.783336:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 173 00000100:00100000:2.0:1788813182.789012:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813182.789270:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308013696 00000100:00100000:1.0:1788813182.789284:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308013696 00000100:00100000:1.0:1788813182.789359:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 174 00000100:00100000:1.0:1788813182.789370:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+17:11519:x1875706308013696:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813182.789407:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813182.789411:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788813182.789447:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ecd8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cde expref: 17 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.789471:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:1.0:1788813182.789478:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788813182.789502:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd400/0x1b294f297b1ecde7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2cf3 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788813182.792518:0:7630:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788813182.793197:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ecdee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.793220:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ecdee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.793245:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ecdee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.793342:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd400/0x1b294f297b1ecde7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cf3 expref: 19 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.793366:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ecdee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cf3 expref: 18 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.793387:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:1.0:1788813182.793392:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813182.793397:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fcc00, rc 0) 00000100:00100000:1.0:1788813182.793623:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+18:11519:x1875706308013696:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 4252us (4624us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1788813182.793635:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 174 00000100:00100000:1.0:1788813182.804569:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813182.804659:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308013952 00000100:00100000:3.0:1788813182.804672:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308013952 00000100:00100000:3.0:1788813182.804856:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 175 00000100:00100000:3.0:1788813182.804870:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+18:11519:x1875706308013952:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788813182.804947:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813182.804983:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ecdee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cf3 expref: 18 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.805006:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93ef19f1f300) 00010000:00010000:3.0:1788813182.805021:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813182.805050:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecdfc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.805066:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecdfc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.805077:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecdfc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.806926:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ece03 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x53cdab65 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.806953:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ece03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x53cdab65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.806980:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ece03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x53cdab65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.807322:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecdfc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.807330:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecdfc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.807337:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecdfc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.807342:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813182.807346:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecdfc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.807353:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecdfc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.807365:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:3.0:1788813182.807368:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813182.807373:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecdfc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.807393:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ecdfc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.807415:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ece03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x53cdab65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.807421:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ece03 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x53cdab65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.807427:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ece03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x53cdab65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.807432:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813182.807435:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ece03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x53cdab65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.807441:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ece03 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x53cdab65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.807449:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x53cdab65 (ffff93ef077b4800) 00010000:00010000:3.0:1788813182.807452:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813182.807456:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ece03 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x53cdab65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.807462:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f000/0x1b294f297b1ece03 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x53cdab65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813182.807577:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+17:11519:x1875706308013952:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 2705us (3016us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788813182.807587:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 175 00000100:00100000:1.0:1788813182.811425:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813182.811502:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308014080 00000100:00100000:3.0:1788813182.811516:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308014080 00000100:00100000:3.0:1788813182.811598:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 176 00000100:00100000:3.0:1788813182.811626:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+17:11519:x1875706308014080:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813182.811655:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813182.811759:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ece0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2cfa expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.811855:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ece11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.811873:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ece11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.811889:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ece11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.812269:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ece0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cfa expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.812294:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ece11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cfa expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813182.812304:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93ef077b4900) 00010000:00010000:3.0:1788813182.812306:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788813182.812311:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef421e8c00, rc 0) 00000100:00100000:3.0:1788813182.812405:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+18:11519:x1875706308014080:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 782us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813182.812414:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 176 00000100:00100000:1.0:1788813182.823174:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813182.823583:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308014336 00000100:00100000:2.0:1788813182.823596:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308014336 00000100:00100000:2.0:1788813182.823684:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 177 00000100:00100000:2.0:1788813182.823695:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+18:11519:x1875706308014336:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788813182.823942:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ece18 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.823963:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ece18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.823978:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ece18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788813182.825544:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1788813182.825563:0:7630:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 343211780743ns, next at 344211776701ns, rc = 0 00000004:00010000:2.0:1788813182.828017:0:7630:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006070184a reply state 00000000c03f4e51 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ece18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813182.828114:0:7630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788813182.828309:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+20:11519:x1875706308014336:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 4609us (5143us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1788813182.828319:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 177 00000100:00100000:1.0:1788813182.840070:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813182.840176:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308014464 00000100:00100000:0.0:1788813182.840189:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308014464 00000100:00100000:0.0:1788813182.840260:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 178 00000100:00100000:0.0:1788813182.840273:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+20:11519:x1875706308014464:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813182.840302:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813182.840329:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ece1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2d01 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813182.840419:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ece1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d01 expref: 21 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813182.840438:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ece1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d01 expref: 21 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813182.840460:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93ef077b4900) 00010000:00010000:0.0:1788813182.840463:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788813182.840468:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cfc00, rc 0) 00000100:00100000:0.0:1788813182.840541:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+21:11519:x1875706308014464:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 272us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813182.840549:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 178 00010000:00010000:2.0:1788813182.844004:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ece18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.844027:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ece18 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.844037:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ece18 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.844043:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813182.844049:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ece18 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.844072:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ece18 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.844095:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93ef077b4900) 00010000:00010000:2.0:1788813182.844099:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788813182.844106:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ece18 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.844113:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ece18 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813182.846619:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813182.846701:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308014592 00000100:00100000:3.0:1788813182.846714:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308014592 00000100:00080000:1.0:1788813182.847022:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813182.847086:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:2.0:1788813182.847102:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3c6efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+6:2363:x1875706308014592:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788813182.847598:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3c6efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+7:2363:x1875706308014592:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 498us (990us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788813182.847609:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:1.0:1788813182.851135:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813182.851219:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308014848 00000100:00100000:2.0:1788813182.851232:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308014848 00000100:00100000:2.0:1788813182.851306:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:2.0:1788813182.851318:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3c6ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+20:11519:x1875706308014848:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788813182.851854:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3c6ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+21:11519:x1875706308014848:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 525us (720us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788813182.851864:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:1.0:1788813182.863132:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813182.863273:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308015104 00000100:00100000:2.0:1788813182.863287:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308015104 00000100:00100000:2.0:1788813182.863361:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 179 00000100:00100000:2.0:1788813182.863392:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+21:11519:x1875706308015104:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788813182.863545:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+21:11519:x1875706308015104:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 166us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813182.863553:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 179 00000100:00100000:3.0:1788813182.870262:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813182.870424:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308015232 00000100:00100000:1.0:1788813182.870438:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308015232 00000100:00100000:1.0:1788813182.870512:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 180 00000100:00100000:1.0:1788813182.870524:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef012ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+21:11519:x1875706308015232:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813182.870559:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813182.870585:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ece26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2d08 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.870687:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ece2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.870705:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ece2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.870718:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ece2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813182.870764:0:7630:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813182.870839:0:7630:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ece2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.870872:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ece26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d08 expref: 23 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.870893:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ece2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d08 expref: 22 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.870904:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93ef077b4900) 00010000:00010000:1.0:1788813182.870907:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788813182.870912:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fca00, rc 0) 00000100:00100000:1.0:1788813182.870992:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef012ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+22:11519:x1875706308015232:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 471us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813182.871001:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 180 00000100:00100000:2.0:1788813182.893342:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813182.893458:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308015360 00000100:00100000:0.0:1788813182.893480:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308015360 00000100:00100000:0.0:1788813182.893553:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:0.0:1788813182.893567:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+7:2364:x1875706308015360:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813182.893591:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813182.893618:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f46618f1/0x1b294f297b1ece34 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2d0f expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788813182.893653:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f1f7e, blocks: 0x1 00010000:00010000:0.0:1788813182.893679:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=343s v=(0 0) 00010000:00010000:0.0:1788813182.893684:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813182.893696:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f46618f1/0x1b294f297b1ece34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d0f expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813182.893719:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f46618f1/0x1b294f297b1ece34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d0f expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813182.893734:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190ce600, rc 0) 00000100:00100000:0.0:1788813182.893960:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+8:2364:x1875706308015360:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 396us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813182.893967:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:1.0:1788813182.900912:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813182.901104:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308015616 00000100:00100000:0.0:1788813182.901116:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308015616 00000100:00100000:0.0:1788813182.901194:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 181 00000100:00100000:0.0:1788813182.901206:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+22:11519:x1875706308015616:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788813182.901351:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+22:11519:x1875706308015616:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 147us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813182.901372:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 181 00000100:00100000:1.0:1788813182.909362:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813182.909458:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308015744 00000100:00100000:2.0:1788813182.909471:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308015744 00000100:00100000:2.0:1788813182.909545:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:2.0:1788813182.909557:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+8:11519:x1875706308015744:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813182.909580:0:8122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813182.909662:0:8122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ece3b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2d16 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.909708:0:8122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f46618f1/0x1b294f297b1ece34 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d0f expref: 9 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.909719:0:8122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813182.909724:0:8122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813182.909730:0:8122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ece3b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d16 expref: 9 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.909773:0:8122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f46618f1/0x1b294f297b1ece34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d0f expref: 9 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.910877:0:8122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f46618f1/0x1b294f297b1ece34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d0f expref: 9 pid: 6676 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813182.910928:0:8122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee07d22a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8122:1875706322689536:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788813182.911065:0:8122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef196b6900 going to sleep for 11 seconds 00000100:00100000:3.0:1788813182.914289:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813182.914459:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308015872 00000100:00100000:1.0:1788813182.914472:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308015872 00010000:00010000:1.0:1788813182.914525:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f46618f1/0x1b294f297b1ece34 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d0f expref: 10 pid: 6676 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813182.914580:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:1.0:1788813182.914591:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef121e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+10:2365:x1875706308015872:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813182.914611:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813182.914644:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f46618f1/0x1b294f297b1ece34 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d0f expref: 10 pid: 6676 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.914660:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f46618f1/0x1b294f297b1ece34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d0f expref: 10 pid: 6676 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.914692:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813182.914698:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813182.914708:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ece3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d16 expref: 10 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.914720:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ece3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d16 expref: 10 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813182.914768:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ece3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d16 expref: 10 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813182.914856:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee07d1e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5820:1875706322689664:192.168.203.13@tcp:105: 00000100:00100000:1.0:1788813182.914961:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef11690780 going to sleep for 11 seconds 00010000:00010000:2.0:1788813182.915463:0:8122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f46618f1/0x1b294f297b1ece34 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d0f expref: 10 pid: 6676 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813182.915484:0:8122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee07d22a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8122:1875706322689536:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788813182.915517:0:8122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ece3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d16 expref: 9 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813182.915641:0:8122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619a00, rc 0) 00000100:00100000:2.0:1788813182.915744:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+9:11519:x1875706308015744:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 6187us (6395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813182.915754:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:0.0:1788813182.919557:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813182.919768:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308016000 00000100:00100000:1.0:1788813182.919919:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee07d1e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5820:1875706322689664:192.168.203.13@tcp:105: 00000100:00100000:3.0:1788813182.919950:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308016000 00010000:00010000:1.0:1788813182.919954:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813182.920034:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef121e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+9:2365:x1875706308015872:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 5443us (5757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813182.920048:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00002000:00100000:0.0:1788813182.920086:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff93ef368cce00 x1875706308016000/t0(0) o4->9c560788-da9a-41fd-952d-091d96dace11@192.168.203.13@tcp:753/0 lens 504/0 e 0 to 0 dl 1788813193 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788813182.920100:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93ef368cce00 with x1875706308016000 ext(0->8) 00002000:00010000:0.0:1788813182.920107:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ef368cce00 00000100:00100000:0.0:1788813182.920141:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:0.0:1788813182.920150:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9c560788-da9a-41fd-952d-091d96dace11+8:2366:x1875706308016000:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788813182.921577:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9c560788-da9a-41fd-952d-091d96dace11+10:2366:x1875706308016000:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 Request processed in 1415us (2021us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788813182.921591:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00002000:00100000:0.0:1788813182.922112:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff93ef368cce00 x1875706308016000/t4294967314(0) o4->9c560788-da9a-41fd-952d-091d96dace11@192.168.203.13@tcp:753/0 lens 504/448 e 0 to 0 dl 1788813193 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788813182.922127:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93ef368cce00 with x1875706308016000 ext(0->8) 00002000:00010000:0.0:1788813182.922134:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ef368cce00 00000100:00100000:0.0:1788813182.925875:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813182.925999:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308016128 00000100:00100000:1.0:1788813182.926013:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308016128 00000100:00100000:1.0:1788813182.926094:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 182 00000100:00100000:1.0:1788813182.926106:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+22:11519:x1875706308016128:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00010000:00010000:0.0:1788813182.942242:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788813182.963615:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000001:00080000:0.0:1788813182.963635:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1788813182.963645:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:0.0:1788813182.963661:0:5856:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:2.0:1788813182.964073:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+18:11519:x1875706308016128:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 37960us (38204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813182.964088:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 182 00000020:00080000:0.0:1788813182.964455:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1788813182.964469:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788813182.964478:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813182.964504:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322689792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788813182.964569:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813182.964626:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322689792 00000100:00100000:0.0:1788813182.964634:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322689792 00000100:00100000:0.0:1788813182.964679:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788813182.964689:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36adce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322689792:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788813182.965023:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788813182.965027:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788813182 00002000:00010000:0.0:1788813182.965029:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788813182.965031:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788813182 -> 1788813182 00002000:00010000:0.0:1788813182.965034:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788813182.965111:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36adce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3299:x1875706322689792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 424us (541us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788813182.965118:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788813182.967374:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813182.967531:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308016256 00000100:00100000:3.0:1788813182.967543:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308016256 00000100:00100000:3.0:1788813182.967607:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:3.0:1788813182.967617:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef012aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+10:2366:x1875706308016256:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000004:00080000:2.0:1788813182.975089:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ef36add500/2, rc 0, transno 4294967315 00000100:00100000:2.0:1788813182.975107:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322689792:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1788813183.029332:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:2.0:1788813183.029353:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1788813183.030228:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef012aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+7:2366:x1875706308016256:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 62601us (62854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813183.030244:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:2.0:1788813183.052420:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813183.053009:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308016512 00000100:00100000:3.0:1788813183.053024:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308016512 00000100:00100000:3.0:1788813183.053097:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 183 00000100:00100000:3.0:1788813183.053109:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+18:11519:x1875706308016512:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788813183.053187:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813183.053221:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ece2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d08 expref: 18 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.053245:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93ef077b4900) 00010000:00010000:3.0:1788813183.053252:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813183.053297:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ece42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.053314:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ece42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.053325:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ece42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813183.056484:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000882765c7 reply state 0000000047a2940f transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ece42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813183.056502:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788813183.056675:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+19:11519:x1875706308016512:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 3563us (4263us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788813183.056686:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 183 00000100:00100000:0.0:1788813183.061596:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813183.061685:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308016640 00000100:00100000:2.0:1788813183.061698:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308016640 00000100:00100000:2.0:1788813183.061777:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:2.0:1788813183.061811:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+7:2365:x1875706308016640:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788813183.062149:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788813183.062154:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788813182 -> 1788813182 00002000:00010000:2.0:1788813183.062156:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788813180 00002000:00010000:2.0:1788813183.062158:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788813182 -> 1788813182 00002000:00010000:2.0:1788813183.062160:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788813183.062232:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+8:2365:x1875706308016640:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 423us (649us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788813183.062241:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00010000:00010000:1.0:1788813183.062804:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ece42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.062819:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ece42 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.062828:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ece42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.062836:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef421e9c00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813183.062841:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ece42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.062851:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ece42 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.062888:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93ef077b4900) 00010000:00010000:1.0:1788813183.062892:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813183.062900:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ece42 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.062907:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9c00/0x1b294f297b1ece42 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813183.074022:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813183.076607:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308016896 00000100:00100000:2.0:1788813183.076629:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308016896 00000100:00100000:0.0:1788813183.077147:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 184 00000100:00100000:0.0:1788813183.077159:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+18:11519:x1875706308016896:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788813183.077248:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ece49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813183.077268:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ece11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cfa expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813183.077279:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ece49 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813183.077326:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ece11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cfa expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813183.077355:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ece11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cfa expref: 18 pid: 5836 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813183.077372:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36add880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875706322689920:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788813183.077513:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee066bb180 going to sleep for 11 seconds 00000100:00100000:0.0:1788813183.079913:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36add880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875706322689920:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788813183.079952:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ece49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813183.083770:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813183.083993:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308017024 00000100:00100000:2.0:1788813183.084006:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308017024 00010000:00010000:2.0:1788813183.084059:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ece11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cfa expref: 19 pid: 5836 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813183.084112:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:2.0:1788813183.084124:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+19:2366:x1875706308017024:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813183.084143:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813183.084152:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ece11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cfa expref: 19 pid: 5836 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.084168:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ece11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cfa expref: 19 pid: 5836 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.084195:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8c00/0x1b294f297b1ece11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2cfa expref: 19 pid: 5836 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.084227:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93ef077b4900) 00010000:00010000:2.0:1788813183.084233:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ece49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.084245:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ece49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.084255:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ece49 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.084289:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813183.084352:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+18:2366:x1875706308017024:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 230us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813183.084361:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 70 00010000:00010000:3.0:1788813183.084584:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ece49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.084593:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ece49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.084851:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ece49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.084861:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ece49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.084868:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ece49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.084874:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cf600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813183.084879:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ece49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.084888:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ece49 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.084900:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93ef077b4900) 00010000:00010000:3.0:1788813183.084912:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788813183.084918:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ece49 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.084925:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf600/0x1b294f297b1ece49 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813183.084984:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+17:11519:x1875706308016896:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 Request processed in 7826us (10974us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788813183.084993:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 184 00000100:00100000:2.0:1788813183.088448:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813183.088531:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308017152 00000100:00100000:3.0:1788813183.088545:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308017152 00000100:00100000:3.0:1788813183.088620:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:3.0:1788813183.088631:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+8:2363:x1875706308017152:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788813183.088687:0:8122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ece50 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.088714:0:8122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ece3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d16 expref: 8 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.088724:0:8122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813183.088730:0:8122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788813183.088735:0:8122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ece50 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.088807:0:8122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ece3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d16 expref: 8 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.088848:0:8122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ece3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d16 expref: 8 pid: 8122 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813183.088866:0:8122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef012af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8122:1875706322690048:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788813183.088963:0:8122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef370fa180 going to sleep for 11 seconds 00000100:00100000:3.0:1788813183.092282:0:8122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef012af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8122:1875706322690048:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788813183.092320:0:8122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ece50 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813183.096511:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813183.096649:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308017280 00000100:00100000:3.0:1788813183.096663:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308017280 00010000:00010000:3.0:1788813183.096716:0:8439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ece3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d16 expref: 9 pid: 8122 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813183.096776:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:3.0:1788813183.096812:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+9:2366:x1875706308017280:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813183.096831:0:8439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813183.096862:0:8439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ece3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d16 expref: 9 pid: 8122 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.096880:0:8439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ece3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d16 expref: 9 pid: 8122 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.096910:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ece3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d16 expref: 9 pid: 8122 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.096945:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788813183.096949:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788813183.096957:0:8439:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ece50 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.096969:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ece50 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.097010:0:8439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813183.097078:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+8:2366:x1875706308017280:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 269us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813183.097086:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 71 00010000:00010000:2.0:1788813183.097249:0:8122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ece50 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.097260:0:8122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ece50 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.097291:0:8122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ece50 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.097301:0:8122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ece50 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.097321:0:8122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ece50 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.097329:0:8122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f000 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:2.0:1788813183.097334:0:8122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ece50 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.097345:0:8122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ece50 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.097361:0:8122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ece50 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.097369:0:8122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ece50 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813183.097442:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+7:2363:x1875706308017152:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 8812us (9009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813183.097451:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:1.0:1788813183.105910:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813183.106092:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308017536 00000100:00100000:3.0:1788813183.106105:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308017536 00000100:00100000:3.0:1788813183.106183:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 185 00000100:00100000:3.0:1788813183.106196:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+17:11519:x1875706308017536:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788813183.106311:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ece57 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.106334:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ece57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.106350:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ece57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.106648:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ece5e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.106675:0:8565:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ece1f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d01 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.106684:0:8565:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ece5e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.106729:0:8565:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ece1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d01 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.106746:0:8565:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ece1f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d01 expref: 18 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813183.106763:0:8565:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef012af100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8565:1875706322690176:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788813183.106919:0:8565:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef370fa180 going to sleep for 11 seconds 00000100:00100000:3.0:1788813183.115034:0:8565:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef012af100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8565:1875706322690176:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788813183.115069:0:8565:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ece5e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813183.115162:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813183.115223:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308017664 00000100:00100000:2.0:1788813183.115232:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308017664 00010000:00010000:2.0:1788813183.115279:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ece1f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d01 expref: 19 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813183.115321:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:2.0:1788813183.115342:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36add880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+19:2366:x1875706308017664:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813183.115359:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813183.115367:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ece1f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d01 expref: 19 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.115393:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ece1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d01 expref: 19 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.115419:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfc00/0x1b294f297b1ece1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d01 expref: 19 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.115437:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93ef077b4900) 00010000:00010000:2.0:1788813183.115442:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ece5e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.115453:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ece5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.115462:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ece5e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.115490:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813183.115546:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36add880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+18:2366:x1875706308017664:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 205us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813183.115554:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 72 00010000:00010000:3.0:1788813183.115673:0:8565:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ece5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.115681:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ece5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788813183.115942:0:8565:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1788813183.116090:0:8565:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1788813183.116135:0:8565:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1788813183.116221:0:8565:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef012af100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8565:1875706322690304:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788813183.116287:0:8565:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813183.116318:0:8565:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef370fa480 going to sleep for 11 seconds 00000100:00100000:2.0:1788813183.116479:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322690304 00000100:00100000:2.0:1788813183.116486:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322690304 00000100:00100000:2.0:1788813183.116551:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788813183.116561:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef012af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8565:x1875706322690304:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788813183.116841:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef012af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8565:x1875706322690304:12345-0@lo:1000:mdt00_004.0 Request processed in 281us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813183.116849:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788813183.116984:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813183.117016:0:8565:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1788813183.117022:0:8565:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ef36add500, transno 4294967315 00000100:00100000:3.0:1788813183.117042:0:8565:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef012af100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8565:1875706322690304:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1788813183.118140:0:8565:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1788813183.118234:0:8565:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef012af100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8565:1875706322690432:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788813183.118310:0:8565:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813183.118347:0:8565:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef370fa180 going to sleep for 11 seconds 00000100:00100000:2.0:1788813183.118451:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322690432 00000100:00100000:2.0:1788813183.118461:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322690432 00000100:00100000:2.0:1788813183.118519:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788813183.118529:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef012aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8565:x1875706322690432:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788813183.119128:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef012aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8565:x1875706322690432:12345-0@lo:1000:mdt00_004.0 Request processed in 598us (816us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788813183.119138:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788813183.119250:0:8565:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef012af100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8565:1875706322690432:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1788813183.119298:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ece5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.119311:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ece5e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.119320:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ece5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.119326:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214cc00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813183.119331:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ece5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.119341:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ece5e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.119360:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93ef077b4900) 00010000:00010000:3.0:1788813183.119363:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813183.119398:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ece5e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.119406:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ece5e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.119447:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ecd93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.119455:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ecd93 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.119461:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ecd93 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.119466:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef421e9e00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813183.119469:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ecd93 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.119475:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ecd93 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.119483:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:3.0:1788813183.119485:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813183.119488:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ecd93 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.119493:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e9e00/0x1b294f297b1ecd93 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.119518:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ece65 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.119534:0:8565:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ecdaf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ce5 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.119549:0:8565:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ece65 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.119581:0:8565:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ecdaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ce5 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.119597:0:8565:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ecdaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ce5 expref: 21 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813183.119610:0:8565:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef012ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8565:1875706322690560:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788813183.119742:0:8565:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef370fa180 going to sleep for 11 seconds 00000100:00100000:0.0:1788813183.126303:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813183.129207:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308017792 00000100:00100000:1.0:1788813183.129223:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308017792 00010000:00010000:1.0:1788813183.129285:0:8439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ecdaf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ce5 expref: 22 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813183.129340:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:1.0:1788813183.129352:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36add500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+22:2365:x1875706308017792:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813183.129372:0:8439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813183.129391:0:8439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ecdaf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ce5 expref: 22 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.129407:0:8439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ecdaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ce5 expref: 22 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.129437:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:1.0:1788813183.129444:0:8439:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ece65 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.129473:0:8439:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ece65 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.129483:0:8439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ece65 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.129509:0:8439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813183.129591:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36add500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+22:2365:x1875706308017792:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 239us (3302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813183.129598:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 73 00010000:00010000:3.0:1788813183.140669:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ecdaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ce5 expref: 21 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813183.140700:0:8565:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef012ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8565:1875706322690560:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788813183.140732:0:8565:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ece65 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.140743:0:8565:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ece65 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.140749:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ece65 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.140766:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ece65 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.140773:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ece65 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.141209:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ece65 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.141218:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214d200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813183.141223:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ece65 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.141234:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ece65 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.141266:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:3.0:1788813183.141270:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813183.141277:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ece65 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.141284:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ece65 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.141298:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ece57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.141305:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ece57 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.141312:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ece57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.141317:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214c600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813183.141320:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ece57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.141339:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ece57 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.141348:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:3.0:1788813183.141351:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788813183.141354:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ece57 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.141360:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ece57 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813183.143188:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+20:11519:x1875706308017536:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 36984us (37285us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1788813183.143204:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 185 00000020:00080000:3.0:1788813183.143211:0:8565:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788813183.147075:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813183.147086:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813183.147510:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788813183.147517:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788813183.148125:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813183.148246:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308018048 00000100:00100000:3.0:1788813183.148260:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308018048 00000100:00100000:3.0:1788813183.148327:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:3.0:1788813183.148340:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef0e7f8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+20:11519:x1875706308018048:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788813183.149349:0:5838:0:(mdd_object.c:4199:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788813183.149488:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1788813183.149554:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ece6c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.149576:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ece6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.149591:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ece6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.149614:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ece6c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.149622:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ece6c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.149628:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ece6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.149656:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788813183.149949:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef0e7f8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+22:11519:x1875706308018048:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 1608us (1828us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788813183.149960:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00000020:00080000:3.0:1788813183.149967:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788813183.150091:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813183.150099:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ece6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813183.150107:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214cc00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813183.150111:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ece6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813183.150120:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ece6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813183.150146:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93ef077b4900) 00010000:00010000:0.0:1788813183.150149:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788813183.150155:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ece6c lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813183.150161:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ece6c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813183.150181:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813183.150182:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813183.150184:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788813183.420028:0:12508:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788813183.420045:0:12508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788813183.420110:0:12508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788813183.420117:0:12508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788813183.539394:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813183.539990:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308018304 00000100:00100000:3.0:1788813183.540007:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308018304 00000100:00100000:3.0:1788813183.540091:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 186 00000100:00100000:3.0:1788813183.540105:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+22:11530:x1875706308018304:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813183.540140:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813183.540268:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ece73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2d1d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.541581:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ece7a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.541619:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ece7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.541636:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ece7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813183.541653:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788813183.542056:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ece73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d1d expref: 25 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.542079:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ece7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d1d expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.542091:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:3.0:1788813183.542095:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788813183.542100:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef4214d200, rc 0) 00000100:00100000:3.0:1788813183.542265:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+24:11530:x1875706308018304:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 2161us (2891us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788813183.542275:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 186 00000100:00100000:3.0:1788813183.550475:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813183.550540:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308018432 00000100:00100000:1.0:1788813183.550553:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308018432 00000100:00100000:1.0:1788813183.550627:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 187 00000100:00100000:1.0:1788813183.550639:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef012ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+24:11530:x1875706308018432:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:1.0:1788813183.550754:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ece88 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.550775:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ece88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.550824:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ece88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.551492:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ece8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.551510:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ece8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.551518:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ece8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.551887:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ece96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.551897:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ece96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.551905:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ece96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788813183.551963:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ece96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.551978:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ece88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.551986:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ece88 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.551994:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ece88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.552001:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fdc00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813183.552006:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ece88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.552014:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ece88 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.552028:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:1.0:1788813183.552032:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813183.552038:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ece88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.552052:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ece88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.552064:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ece8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.552070:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ece8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.552076:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ece8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.552081:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fde00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813183.552084:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ece8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.552090:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ece8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.552098:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ef19f1f100) 00010000:00010000:1.0:1788813183.552101:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813183.552104:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ece8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.552122:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ece8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.552140:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ece96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.552146:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ece96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.552157:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ece96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.552162:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fc000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813183.552165:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ece96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.552479:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ece96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.552489:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef19f1fc00) 00010000:00010000:1.0:1788813183.552492:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813183.552495:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ece96 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.552501:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ece96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813183.552619:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef012ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+24:11530:x1875706308018432:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 1978us (2153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813183.552630:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 187 00000100:00100000:1.0:1788813183.606615:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813183.606697:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308018688 00000100:00100000:3.0:1788813183.606710:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308018688 00000100:00100000:3.0:1788813183.606813:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 188 00000100:00100000:3.0:1788813183.606826:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+24:11533:x1875706308018688:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813183.606854:0:8565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813183.606882:0:8565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ece9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2d24 expref: -99 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.606998:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ecea4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.607243:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ecea4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.607261:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ecea4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.607280:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1eceab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.607287:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1eceab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.607294:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1eceab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.608586:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1eceb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.608604:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1eceb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.608616:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1eceb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813183.608629:0:8565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788813183.608746:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ecea4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.608754:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ecea4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.608772:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ecea4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.608804:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214d000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813183.608810:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ecea4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.608820:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ecea4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.608834:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:3.0:1788813183.608838:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813183.608844:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ecea4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.608850:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ecea4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.608865:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1eceab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.608871:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1eceab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.608876:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1eceab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.608881:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214d600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813183.608883:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1eceab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.608899:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1eceab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.608908:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ef077b4c00) 00010000:00010000:3.0:1788813183.608910:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813183.608913:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1eceab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.608919:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1eceab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.610834:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ece9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d24 expref: 27 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.610863:0:8565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1eceb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d24 expref: 26 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.610873:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef077b4800) 00010000:00010000:3.0:1788813183.610876:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813183.610880:0:8565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef4214cc00, rc 0) 00000100:00100000:3.0:1788813183.610981:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+26:11533:x1875706308018688:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 4157us (4377us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788813183.610991:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 188 00000100:00100000:2.0:1788813183.615697:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813183.615863:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308018816 00000100:00100000:0.0:1788813183.615877:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308018816 00000100:00100000:0.0:1788813183.615951:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 189 00000100:00100000:0.0:1788813183.615963:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+26:11533:x1875706308018816:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:0.0:1788813183.616050:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ecec0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813183.616071:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ecec0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813183.616088:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ecec0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813183.616123:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ecec0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813183.616131:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ecec0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813183.616139:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ecec0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813183.616167:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cea00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813183.616173:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ecec0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813183.616183:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ecec0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813183.616198:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef077b4800) 00010000:00010000:0.0:1788813183.616201:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788813183.616207:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ecec0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813183.616213:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ecec0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813183.616312:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+26:11533:x1875706308018816:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 350us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813183.616321:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 189 00000100:00100000:2.0:1788813183.621504:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813183.621648:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308019072 00000100:00100000:1.0:1788813183.621664:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308019072 00000100:00100000:0.0:1788813183.622170:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:0.0:1788813183.622193:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+26:11533:x1875706308019072:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1788813183.622563:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+27:11533:x1875706308019072:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 382us (1074us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1788813183.622572:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:2.0:1788813183.678772:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813183.678927:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308019328 00000100:00100000:2.0:1788813183.678940:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308019328 00000100:00100000:2.0:1788813183.679149:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 190 00000100:00100000:2.0:1788813183.679163:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+27:11067:x1875706308019328:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1788813183.679195:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813183.679224:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecec7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2d2b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.679360:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecece lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.679389:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1eceb2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d24 expref: 28 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.679414:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecece lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.679458:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1eceb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d24 expref: 28 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.679473:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1eceb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d24 expref: 28 pid: 8565 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813183.679491:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee07d23480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875706322690688:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788813183.679622:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef21238c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813183.689577:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813183.689953:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee07d23480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875706322690688:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788813183.689992:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecece lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813183.690114:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308019456 00000100:00100000:3.0:1788813183.690123:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308019456 00010000:00010000:3.0:1788813183.690175:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1eceb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d24 expref: 29 pid: 8565 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813183.690237:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:3.0:1788813183.690247:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36adea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+29:2366:x1875706308019456:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813183.690269:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813183.690278:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1eceb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d24 expref: 29 pid: 8565 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.690291:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1eceb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d24 expref: 29 pid: 8565 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.690320:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1eceb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d24 expref: 29 pid: 8565 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.690344:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef077b4800) 00010000:00010000:3.0:1788813183.690351:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecece lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.690362:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecece lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.690379:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecece lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.690412:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813183.690477:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36adea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+28:2366:x1875706308019456:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 230us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813183.690485:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 74 00010000:00010000:2.0:1788813183.690823:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecece lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.690832:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecece lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813183.690856:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788813183.691052:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ecec7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d2b expref: 29 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.691072:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecece lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d2b expref: 28 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.691094:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef077b4800) 00010000:00010000:2.0:1788813183.691097:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788813183.691100:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619200, rc 0) 00000100:00100000:2.0:1788813183.691864:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+28:11067:x1875706308019328:12345-192.168.203.13@tcp:101:bash.0 Request processed in 12701us (13103us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1788813183.691874:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 190 00000100:00100000:2.0:1788813183.698228:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813183.700844:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308019712 00000100:00100000:3.0:1788813183.700885:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308019712 00000100:00100000:3.0:1788813183.700969:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 191 00000100:00100000:3.0:1788813183.700982:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+28:11067:x1875706308019712:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:3.0:1788813183.701349:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ecedc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.701382:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ecedc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.701397:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ecedc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788813183.701461:0:8565:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1788813183.701487:0:8565:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000118ce862 reply state 00000000f716ab0e transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ecedc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813183.701497:0:8565:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788813183.702053:0:8565:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1788813183.702348:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+32:11067:x1875706308019712:12345-192.168.203.13@tcp:36:bash.0 Request processed in 1364us (4129us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1788813183.702428:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 191 00000020:00080000:3.0:1788813183.702437:0:8565:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788813183.704941:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ecedc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813183.704953:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00010000:00010000:3.0:1788813183.704960:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ecedc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.704971:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ecedc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.704979:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214cc00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813183.704998:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ecedc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.705007:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ecedc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.705031:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef077b4800) 00010000:00010000:3.0:1788813183.705036:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813183.705041:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ecedc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.705049:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ecedc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813183.705181:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308019840 00000100:00100000:0.0:1788813183.705192:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308019840 00000100:00100000:0.0:1788813183.705255:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 192 00000100:00100000:0.0:1788813183.705266:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+31:11067:x1875706308019840:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788813183.705302:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813183.705324:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ecee3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2d32 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813183.705402:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ecee3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d32 expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813183.705419:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ecee3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d32 expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813183.705437:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef077b4800) 00010000:00010000:0.0:1788813183.705441:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788813183.705443:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cea00, rc 0) 00000100:00100000:0.0:1788813183.705519:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+32:11067:x1875706308019840:12345-192.168.203.13@tcp:101:bash.0 Request processed in 254us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813183.705527:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 192 00000100:00100000:0.0:1788813183.709273:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813183.709359:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308019968 00000100:00100000:2.0:1788813183.709386:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308019968 00000100:00100000:2.0:1788813183.709459:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:2.0:1788813183.709472:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+7:11067:x1875706308019968:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1788813183.709492:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813183.709514:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1eceea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2d39 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788813183.709541:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f1f7e, atime: 0x6a9f1f7c, ctime: 0x6a9f1f7e, blocks: 0xb 00010000:00010000:2.0:1788813183.709566:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=344s v=(0 0) 00010000:00010000:2.0:1788813183.709571:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813183.709580:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1eceea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d39 expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.709600:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1eceea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d39 expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.709628:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619c00, rc 0) 00000100:00100000:2.0:1788813183.709701:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+8:11067:x1875706308019968:12345-192.168.203.13@tcp:101:bash.0 Request processed in 232us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813183.709708:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:2.0:1788813183.737622:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813183.737760:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308020096 00000100:00100000:1.0:1788813183.737771:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308020096 00002000:00010000:1.0:1788813183.737862:0:6681:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1788813183.737867:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93ee07d20700 with x1875706308020096 ext(0->18446744073709551615) 00002000:00010000:1.0:1788813183.737879:0:6681:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ee07d20700. 00000100:00100000:1.0:1788813183.737926:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:1.0:1788813183.737937:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9c560788-da9a-41fd-952d-091d96dace11+8:2364:x1875706308020096:12345-192.168.203.13@tcp:10:bash.0 00002000:00010000:1.0:1788813183.738190:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788813183.738194:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788813182 -> 1788813183 00002000:00010000:1.0:1788813183.738196:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788813180 -> 1788813180 00002000:00010000:1.0:1788813183.738199:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788813182 -> 1788813183 00002000:00010000:1.0:1788813183.738201:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788813183.738266:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9c560788-da9a-41fd-952d-091d96dace11+9:2364:x1875706308020096:12345-192.168.203.13@tcp:10:bash.0 Request processed in 330us (653us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788813183.738274:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00002000:00010000:1.0:1788813183.738278:0:6681:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1788813183.738280:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93ee07d20700 with x1875706308020096 ext(0->18446744073709551615) 00002000:00010000:1.0:1788813183.738285:0:6681:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ee07d20700. 00000100:00100000:0.0:1788813183.828904:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813183.829129:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308020224 00000100:00100000:2.0:1788813183.829139:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308020224 00000100:00100000:2.0:1788813183.829198:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 193 00000100:00100000:2.0:1788813183.829208:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+32:11546:x1875706308020224:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:2.0:1788813183.829278:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ecef1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829295:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ecef1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829308:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ecef1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829323:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecef8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829330:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829335:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829569:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1eceff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829592:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1eceff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829600:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1eceff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788813183.829640:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1eceff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829652:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ecef1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829659:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ecef1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829665:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ecef1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829671:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813183.829676:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ecef1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829684:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ecef1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829695:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:2.0:1788813183.829698:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813183.829703:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ecef1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829709:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ecef1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829729:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829735:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecef8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829741:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecef8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829745:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619e00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813183.829748:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecef8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829759:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecef8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829777:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ef10b7a500) 00010000:00010000:2.0:1788813183.829847:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813183.829852:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecef8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829857:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecef8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829872:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1eceff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829877:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1eceff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829882:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1eceff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829892:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619a00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813183.829895:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1eceff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829901:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1eceff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829911:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef077b4800) 00010000:00010000:2.0:1788813183.829913:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813183.829916:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1eceff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.829922:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1eceff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813183.830091:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+32:11546:x1875706308020224:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 884us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813183.830100:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 193 00000100:00100000:2.0:1788813183.880529:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813183.880655:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308020480 00000100:00100000:3.0:1788813183.880669:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308020480 00000100:00100000:3.0:1788813183.880748:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 194 00000100:00100000:3.0:1788813183.880773:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+32:11550:x1875706308020480:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813183.880860:0:8565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813183.880888:0:8565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ecf06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2d40 expref: -99 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.880985:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ecf0d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.881003:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ecf0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.881029:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ecf0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.881046:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1ecf14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.881067:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1ecf14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.881074:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1ecf14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.881418:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ecf1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.881430:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ecf1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.881438:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ecf1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813183.881450:0:8565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788813183.881565:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ecf0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.881573:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ecf0d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.881581:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ecf0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.881588:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214c600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813183.881593:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ecf0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.881602:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ecf0d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.881627:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:3.0:1788813183.881630:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813183.881637:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ecf0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.881644:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ecf0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.881660:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1ecf14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.881667:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1ecf14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.881673:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1ecf14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.881679:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214d600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813183.881682:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1ecf14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.881688:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1ecf14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.881695:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ef077b4c00) 00010000:00010000:3.0:1788813183.881697:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813183.881701:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1ecf14 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.881706:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1ecf14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.881770:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ecf06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d40 expref: 35 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.881849:0:8565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ecf1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d40 expref: 34 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813183.881858:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef077b4800) 00010000:00010000:3.0:1788813183.881860:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788813183.881863:0:8565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef4214d000, rc 0) 00000100:00100000:3.0:1788813183.881946:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+34:11550:x1875706308020480:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1178us (1431us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1788813183.881956:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 194 00000100:00100000:1.0:1788813183.887163:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813183.887335:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308020608 00000100:00100000:2.0:1788813183.887350:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308020608 00000100:00100000:2.0:1788813183.887491:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 195 00000100:00100000:2.0:1788813183.887504:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+34:11550:x1875706308020608:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:2.0:1788813183.887622:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecf29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.887645:0:7630:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecece lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d2b expref: 34 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.887681:0:7630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecf29 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.887728:0:7630:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecece lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d2b expref: 34 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.887745:0:7630:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecece lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d2b expref: 34 pid: 5836 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813183.887763:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee07d23100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7630:1875706322690816:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788813183.887934:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef21238c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813183.890671:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813183.891127:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee07d23100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7630:1875706322690816:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788813183.891152:0:7630:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecf29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813183.891257:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308020864 00000100:00100000:1.0:1788813183.891265:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308020864 00000100:00100000:1.0:1788813183.891322:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:1.0:1788813183.891331:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+35:5598:x1875706308020864:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788813183.891660:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+36:5598:x1875706308020864:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 328us (996us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788813183.891667:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:0.0:1788813183.893584:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813183.893762:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308020992 00000100:00100000:1.0:1788813183.893770:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308020992 00010000:00010000:1.0:1788813183.894148:0:8439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecece lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d2b expref: 36 pid: 5836 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813183.894254:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:1.0:1788813183.894264:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36459180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+36:2366:x1875706308020992:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813183.894282:0:8439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813183.894289:0:8439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecece lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d2b expref: 36 pid: 5836 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.894300:0:8439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecece lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d2b expref: 36 pid: 5836 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.894321:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecece lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d2b expref: 36 pid: 5836 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.894336:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef077b4800) 00010000:00010000:1.0:1788813183.894341:0:8439:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecf29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.894350:0:8439:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecf29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.894357:0:8439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecf29 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813183.894398:0:8439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813183.894458:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36459180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+35:2366:x1875706308020992:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 194us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813183.894464:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 75 00010000:00010000:2.0:1788813183.897480:0:7630:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecf29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.897500:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecf29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.897538:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecf29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.897545:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecf29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.897552:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecf29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.897575:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619a00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813183.897579:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecf29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.897587:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecf29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.897603:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef077b4800) 00010000:00010000:2.0:1788813183.897606:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813183.897611:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecf29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813183.897617:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecf29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813183.897717:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+34:11550:x1875706308020608:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 10212us (10564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813183.897745:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 195 00000100:00100000:0.0:1788813183.901433:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813183.901503:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308021248 00000100:00100000:1.0:1788813183.901532:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308021248 00000100:00100000:1.0:1788813183.901600:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:1.0:1788813183.901621:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36458700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+34:11550:x1875706308021248:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1788813183.901900:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36458700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+35:11550:x1875706308021248:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 281us (481us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788813183.901908:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:3.0:1788813183.951309:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813183.951352:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813183.951386:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813183.951424:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813183.951522:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308021376 00000100:00100000:1.0:1788813183.951533:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308021376 00000100:00100000:1.0:1788813183.951594:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 294 00000100:00100000:1.0:1788813183.951604:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+13:2363:x1875706308021376:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813183.951665:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+13:2363:x1875706308021376:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 63us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813183.951672:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 294 00000100:00100000:2.0:1788813183.951754:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308021504 00000100:00100000:2.0:1788813183.951758:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308021504 00000100:00100000:2.0:1788813183.951812:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308021632 00000100:00100000:2.0:1788813183.951814:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308021632 00000100:00100000:2.0:1788813183.951831:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:2.0:1788813183.951837:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef012ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+7:2363:x1875706308021504:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813183.951863:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef012ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+7:2363:x1875706308021504:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 27us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813183.951868:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:2.0:1788813183.951879:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:2.0:1788813183.951897:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef012afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+9:2363:x1875706308021632:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813183.951918:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef012afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+9:2363:x1875706308021632:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 22us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813183.951923:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00080000:1.0:1788813183.952070:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813183.956673:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308021760 00000100:00100000:0.0:1788813183.956687:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308021760 00000100:00100000:0.0:1788813183.956816:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 151 00000100:00100000:0.0:1788813183.956829:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef012adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2363:x1875706308021760:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813183.956901:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef012adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2363:x1875706308021760:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 75us (5547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813183.956925:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 151 00000100:00080000:1.0:1788813183.957171:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788813183.966068:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813184.016097:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813184.016264:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308022016 00000100:00100000:1.0:1788813184.016278:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308022016 00000100:00100000:1.0:1788813184.016390:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 196 00000100:00100000:1.0:1788813184.016403:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3645b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+35:11560:x1875706308022016:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:1.0:1788813184.016437:0:8565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813184.016463:0:8565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecf30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2d47 expref: -99 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.016563:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ecf37 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.016583:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ecf37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.016631:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ecf37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.016650:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ecf3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.016658:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ecf3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.016665:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ecf3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.017231:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ecf45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.017243:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ecf45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.017251:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ecf45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813184.017263:0:8565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788813184.017391:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ecf37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.017399:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ecf37 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.017407:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ecf37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.017413:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fde00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813184.017425:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ecf37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.017435:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ecf37 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.017449:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:1.0:1788813184.017453:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813184.017459:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ecf37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.017466:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ecf37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.017480:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ecf3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.017486:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ecf3e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.017492:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ecf3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.017497:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fdc00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813184.017500:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ecf3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.017505:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ecf3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.017513:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ef19f1fc00) 00010000:00010000:1.0:1788813184.017515:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813184.017526:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ecf3e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.017531:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ecf3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.017591:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecf30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d47 expref: 38 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.018097:0:8565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ecf45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d47 expref: 37 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.018107:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef077b4800) 00010000:00010000:1.0:1788813184.018110:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813184.018114:0:8565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fce00, rc 0) 00000100:00080000:0.0:1788813184.018290:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813184.018332:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3645b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+37:11560:x1875706308022016:12345-192.168.203.13@tcp:101:cat.0 Request processed in 1930us (2248us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788813184.018343:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 196 00000100:00100000:0.0:1788813184.025192:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813184.025406:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308022272 00000100:00100000:1.0:1788813184.025420:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308022272 00000100:00100000:1.0:1788813184.025533:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:1.0:1788813184.025546:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3645b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+37:11560:x1875706308022272:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:1.0:1788813184.026181:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3645b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+38:11560:x1875706308022272:12345-192.168.203.13@tcp:35:cat.0 Request processed in 635us (1001us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788813184.026190:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:3.0:1788813184.052104:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813184.052327:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308022528 00000100:00100000:2.0:1788813184.052340:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308022528 00000100:00100000:2.0:1788813184.052435:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 197 00000100:00100000:2.0:1788813184.052447:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef012aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+38:11562:x1875706308022528:12345-192.168.203.13@tcp:36:rm.0 00010000:00010000:2.0:1788813184.052523:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788813184.052558:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ecf45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d47 expref: 38 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.052583:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ecf1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d40 expref: 37 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.052597:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ecee3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d32 expref: 36 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.052619:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef077b4800) 00010000:00010000:2.0:1788813184.052632:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813184.052660:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecf53 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.052676:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecf53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.052688:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecf53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.052730:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ecf5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.052739:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ecf5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.052746:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ecf5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.053358:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecf61 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.053380:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecf61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.053390:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecf61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788813184.054046:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1788813184.054064:0:7630:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 344440277246ns, next at 345440273952ns, rc = 0 00010000:00010000:2.0:1788813184.054140:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecf68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.054152:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecf68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.054162:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecf68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.054170:0:7630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecf68 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.054189:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecf68 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.054195:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecf68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.054217:0:7630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813184.054245:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecf61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.054251:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecf61 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.054258:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecf61 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.054264:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813184.054269:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecf61 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.054278:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecf61 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.054291:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef10b7a000) 00010000:00010000:2.0:1788813184.054295:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788813184.054300:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecf61 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.054307:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ecf61 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.054328:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecf53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.054340:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecf53 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.054778:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813184.054809:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecf68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.054836:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619e00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:1.0:1788813184.054840:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecf68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.054846:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecf68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.054857:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93ef10b7a000) 00010000:00010000:1.0:1788813184.054859:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788813184.054863:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecf68 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.054869:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ecf68 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.054888:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813184.054891:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813184.054892:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813184.055031:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecf53 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.055038:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619a00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813184.055041:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecf53 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.055048:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecf53 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.055057:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:2.0:1788813184.055059:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813184.055063:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecf53 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.055069:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ecf53 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788813184.055081:0:7630:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007a976fa reply state 000000004d2fb977 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ecf5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813184.055091:0:7630:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788813184.055236:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef012aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+37:11562:x1875706308022528:12345-192.168.203.13@tcp:36:rm.0 Request processed in 2787us (3141us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788813184.055247:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 197 00010000:00010000:1.0:1788813184.059664:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ecf5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.059686:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ecf5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.059696:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ecf5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.059703:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813184.059709:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ecf5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.059741:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ecf5a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.059763:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ef10b7a500) 00010000:00010000:1.0:1788813184.059766:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813184.059772:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ecf5a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.059779:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ecf5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813184.119918:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813184.120045:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308022784 00000100:00100000:0.0:1788813184.120057:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308022784 00000100:00100000:0.0:1788813184.120123:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 198 00000100:00100000:0.0:1788813184.120133:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef012ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+36:11568:x1875706308022784:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788813184.120166:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813184.120193:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecf6f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2d4e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.120414:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecf76 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.120433:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecf76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.120449:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecf76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.120468:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecf7d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.120475:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecf7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.120481:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecf7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788813184.121268:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788813184.121569:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ecf84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.121583:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ecf84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.121595:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ecf84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.121640:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecf76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.121647:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecf76 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.121654:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecf76 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.121661:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cee00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813184.121666:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecf76 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.121675:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecf76 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.121688:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:0.0:1788813184.121692:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813184.121698:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecf76 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.121717:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecf76 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813184.121735:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bca6826b reply state 000000001022b1b7 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecf7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813184.121745:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788813184.121846:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ecf6f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d4e expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.121863:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ecf84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d4e expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.121871:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef1a079d00) 00010000:00010000:0.0:1788813184.121874:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813184.121876:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190ce600, rc 0) 00000100:00100000:0.0:1788813184.121965:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef012ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+39:11568:x1875706308022784:12345-192.168.203.13@tcp:101:bash.0 Request processed in 1833us (2060us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788813184.121975:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 198 00010000:00010000:2.0:1788813184.129037:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecf7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.129086:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecf7d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.129094:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecf7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.129100:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cf000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813184.129106:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecf7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.129115:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecf7d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.129134:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ef1a079b00) 00010000:00010000:2.0:1788813184.129137:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813184.129143:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecf7d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.129149:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ecf7d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813184.130012:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813184.130745:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308022912 00000100:00100000:2.0:1788813184.130760:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308022912 00000100:00100000:2.0:1788813184.131495:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:2.0:1788813184.131508:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef012adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+7:2366:x1875706308022912:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1788813184.131531:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813184.131557:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6b44bf6/0x1b294f297b1ecf92 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2d55 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788813184.131616:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813184.131644:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=344s v=(0 0) 00010000:00010000:2.0:1788813184.131650:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813184.131661:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6b44bf6/0x1b294f297b1ecf92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d55 expref: 8 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.131685:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c6b44bf6/0x1b294f297b1ecf92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d55 expref: 8 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.133110:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619a00, rc 0) 00000100:00100000:2.0:1788813184.133469:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef012adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+8:2366:x1875706308022912:12345-192.168.203.13@tcp:101:bash.0 Request processed in 1944us (3446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813184.133490:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:3.0:1788813184.143617:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813184.143728:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308023040 00000100:00100000:2.0:1788813184.143741:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308023040 00000100:00100000:2.0:1788813184.143981:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:2.0:1788813184.143994:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef012ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+8:11568:x1875706308023040:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1788813184.144018:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813184.144041:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ecf99 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2d5c expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.144082:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6b44bf6/0x1b294f297b1ecf92 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d55 expref: 9 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.144115:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813184.144119:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813184.144126:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ecf99 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d5c expref: 9 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.144169:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c6b44bf6/0x1b294f297b1ecf92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d55 expref: 9 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.144184:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c6b44bf6/0x1b294f297b1ecf92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d55 expref: 9 pid: 6675 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813184.144201:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee07d23100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6676:1875706322690944:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788813184.144453:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef21238480 going to sleep for 11 seconds 00000100:00100000:2.0:1788813184.147169:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee07d23100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6676:1875706322690944:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788813184.147229:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ecf99 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d5c expref: 9 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.147256:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619200, rc 0) 00000100:00100000:2.0:1788813184.147331:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef012ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+9:11568:x1875706308023040:12345-192.168.203.13@tcp:101:bash.0 Request processed in 3339us (3727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813184.147342:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:3.0:1788813184.148480:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813184.149224:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308023168 00000100:00100000:2.0:1788813184.149241:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308023168 00010000:00010000:2.0:1788813184.149300:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c6b44bf6/0x1b294f297b1ecf92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d55 expref: 9 pid: 6675 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813184.149377:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:2.0:1788813184.149388:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef121e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+9:2365:x1875706308023168:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813184.149407:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813184.149439:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c6b44bf6/0x1b294f297b1ecf92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d55 expref: 9 pid: 6675 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.149452:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c6b44bf6/0x1b294f297b1ecf92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d55 expref: 9 pid: 6675 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.149482:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6b44bf6/0x1b294f297b1ecf92 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d55 expref: 9 pid: 6675 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.149503:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813184.149508:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813184.149518:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ecf99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d5c expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.149531:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ecf99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d5c expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.149579:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ecf99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d5c expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813184.149599:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee07d23100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1875706322691072:192.168.203.13@tcp:105: 00000100:00100000:2.0:1788813184.149714:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef21238480 going to sleep for 11 seconds 00000100:00100000:2.0:1788813184.154473:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee07d23100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1875706322691072:192.168.203.13@tcp:105: 00010000:00010000:2.0:1788813184.154508:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813184.154609:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef121e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+8:2365:x1875706308023168:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 5221us (6137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813184.154622:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:0.0:1788813184.160090:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813184.160198:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308023424 00000100:00100000:3.0:1788813184.160218:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308023424 00000100:00100000:3.0:1788813184.160283:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:3.0:1788813184.160294:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+38:11568:x1875706308023424:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:3.0:1788813184.161127:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+39:11568:x1875706308023424:12345-192.168.203.13@tcp:35:bash.0 Request processed in 827us (1046us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788813184.161157:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:3.0:1788813184.280033:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813184.280186:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308023552 00000100:00100000:1.0:1788813184.280199:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308023552 00000100:00100000:1.0:1788813184.280276:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 199 00000100:00100000:1.0:1788813184.280289:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef012ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+39:11584:x1875706308023552:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813184.280320:0:8565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813184.280348:0:8565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ecfa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2d63 expref: -99 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.280456:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ecfa7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.280474:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ecfa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.280488:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ecfa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813184.280536:0:8565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788813184.280558:0:8565:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813184.280587:0:8565:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ecfa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.280618:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ecfa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d63 expref: 41 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.280640:0:8565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ecfa7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d63 expref: 40 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.280650:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:1.0:1788813184.280653:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813184.280658:0:8565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fce00, rc 0) 00000100:00100000:1.0:1788813184.280749:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef012ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+40:11584:x1875706308023552:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 462us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813184.280757:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 199 00000100:00100000:2.0:1788813184.285983:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813184.286131:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308023808 00000100:00100000:1.0:1788813184.286144:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308023808 00000100:00100000:1.0:1788813184.286225:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 200 00000100:00100000:1.0:1788813184.286236:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+40:11584:x1875706308023808:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813184.286265:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813184.286292:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ecfae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2d6a expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.286435:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecfb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.286452:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecfb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.286489:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecfb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813184.286504:0:7630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788813184.286667:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ecfae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d6a expref: 43 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.286687:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecfb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d6a expref: 42 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.286696:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef1a079d00) 00010000:00010000:1.0:1788813184.286699:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813184.286703:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fc000, rc 0) 00000100:00100000:1.0:1788813184.286849:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+42:11584:x1875706308023808:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 614us (880us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788813184.286858:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 200 00000100:00100000:2.0:1788813184.290745:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813184.291011:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308024064 00000100:00100000:1.0:1788813184.291025:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308024064 00000100:00100000:1.0:1788813184.291103:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 201 00000100:00100000:1.0:1788813184.291115:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+42:11584:x1875706308024064:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813184.291146:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813184.291172:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ecfc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2d71 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.291301:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ecfca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.291339:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ecfca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.291354:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ecfca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813184.291380:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788813184.291542:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd200/0x1b294f297b1ecfc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d71 expref: 45 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.291565:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ecfca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d71 expref: 44 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.291574:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef1a079d00) 00010000:00010000:1.0:1788813184.291577:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788813184.291582:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fd000, rc 0) 00000100:00100000:1.0:1788813184.291666:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+44:11584:x1875706308024064:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 553us (937us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788813184.291674:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 201 00000100:00100000:3.0:1788813184.297394:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813184.297516:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308024192 00000100:00100000:0.0:1788813184.297530:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308024192 00000100:00100000:0.0:1788813184.297615:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:0.0:1788813184.297628:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef012ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+44:2364:x1875706308024192:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813184.297649:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813184.297683:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ecfb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d6a expref: 44 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.297730:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef1a079d00) 00010000:00010000:0.0:1788813184.297737:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813184.297872:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef012ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+43:2364:x1875706308024192:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 247us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813184.297880:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:2.0:1788813184.301089:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813184.301433:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308024320 00000100:00100000:0.0:1788813184.301446:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308024320 00000100:00100000:0.0:1788813184.301550:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:0.0:1788813184.301562:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+8:2365:x1875706308024320:12345-192.168.203.13@tcp:1:lfs.0 00010000:00010000:0.0:1788813184.301632:0:8122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d494528/0x1b294f297b1ecfd8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.301658:0:8122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ecf99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d5c expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.301668:0:8122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813184.301673:0:8122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813184.301679:0:8122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d494528/0x1b294f297b1ecfd8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.301724:0:8122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ecf99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d5c expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.301740:0:8122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ecf99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d5c expref: 8 pid: 6676 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813184.302025:0:8122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36459180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8122:1875706322691200:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788813184.302140:0:8122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee066bb480 going to sleep for 11 seconds 00000100:00100000:1.0:1788813184.305139:0:8122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36459180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8122:1875706322691200:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788813184.305181:0:8122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004d494528/0x1b294f297b1ecfd8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813184.305828:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813184.306115:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308024448 00000100:00100000:0.0:1788813184.306125:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308024448 00002000:00100000:0.0:1788813184.306196:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff93ef012ac000 x1875706308024448/t0(0) o4->9c560788-da9a-41fd-952d-091d96dace11@192.168.203.13@tcp:0/0 lens 504/0 e 0 to 0 dl 1788813195 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788813184.306208:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93ef012ac000 with x1875706308024448 ext(0->8) 00010000:00010000:0.0:1788813184.306217:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ecf99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d5c expref: 9 pid: 6676 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.306233:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ecf99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d5c expref: 9 pid: 6676 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788813184.306242:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93ef012ac000 00000100:00100000:0.0:1788813184.306279:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:0.0:1788813184.306289:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef012ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9c560788-da9a-41fd-952d-091d96dace11+9:2366:x1875706308024448:12345-192.168.203.13@tcp:4:lfs.0 00000100:00100000:0.0:1788813184.307412:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef012ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9c560788-da9a-41fd-952d-091d96dace11+11:2366:x1875706308024448:12345-192.168.203.13@tcp:4:lfs.0 Request processed in 1116us (1579us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788813184.307426:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00002000:00100000:0.0:1788813184.307438:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff93ef012ac000 x1875706308024448/t4294967308(0) o4->9c560788-da9a-41fd-952d-091d96dace11@192.168.203.13@tcp:0/0 lens 504/448 e 0 to 0 dl 1788813195 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788813184.307447:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93ef012ac000 with x1875706308024448 ext(0->8) 00010000:00010000:0.0:1788813184.307456:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ecf99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d5c expref: 11 pid: 6676 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.307480:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ecf99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d5c expref: 11 pid: 6676 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788813184.307488:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93ef012ac000 00000100:00100000:0.0:1788813184.310536:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813184.310763:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308024576 00000100:00100000:1.0:1788813184.311099:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308024576 00010000:00010000:1.0:1788813184.311166:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ecf99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d5c expref: 11 pid: 6676 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813184.311284:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:1.0:1788813184.311297:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36459180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+11:2365:x1875706308024576:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813184.311317:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788813184.311343:0:5819:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788813184.311347:0:5819:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788813184 00002000:00010000:1.0:1788813184.311350:0:5819:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788813184 00002000:00010000:1.0:1788813184.311353:0:5819:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788813184 00010000:00010000:1.0:1788813184.311359:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ecf99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d5c expref: 11 pid: 6676 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.311383:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ecf99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d5c expref: 11 pid: 6676 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.311412:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ecf99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d5c expref: 11 pid: 6676 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.311433:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788813184.311438:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788813184.311445:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004d494528/0x1b294f297b1ecfd8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.311455:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d494528/0x1b294f297b1ecfd8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.311493:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813184.311572:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36459180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+10:2365:x1875706308024576:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 278us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813184.311581:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 77 00010000:00010000:0.0:1788813184.311925:0:8122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004d494528/0x1b294f297b1ecfd8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.311937:0:8122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d494528/0x1b294f297b1ecfd8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.311969:0:8122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d494528/0x1b294f297b1ecfd8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.311978:0:8122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d494528/0x1b294f297b1ecfd8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.311988:0:8122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d494528/0x1b294f297b1ecfd8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.311996:0:8122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cfe00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813184.312001:0:8122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d494528/0x1b294f297b1ecfd8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.312011:0:8122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d494528/0x1b294f297b1ecfd8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.312036:0:8122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d494528/0x1b294f297b1ecfd8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.312044:0:8122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d494528/0x1b294f297b1ecfd8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813184.312116:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+9:2365:x1875706308024320:12345-192.168.203.13@tcp:1:lfs.0 Request processed in 10556us (11041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813184.312126:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:0.0:1788813184.318742:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813184.318943:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308024832 00000100:00100000:3.0:1788813184.318958:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308024832 00000100:00100000:3.0:1788813184.319035:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:3.0:1788813184.319048:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef0e7fac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+43:11584:x1875706308024832:12345-192.168.203.13@tcp:35:lfs.0 00000004:00010000:3.0:1788813184.319132:0:5838:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ecfca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d71 expref: 43 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788813184.319531:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1788813184.319582:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1788813184.320283:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1788813184.320357:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ecfdf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.320386:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ecf84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d4e expref: 47 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.320397:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ecfdf lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.320443:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ecf84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d4e expref: 47 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.320464:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ecf84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d4e expref: 47 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813184.320499:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef012af480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5838:1875706322691328:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788813184.320628:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef370fad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813184.323444:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813184.323544:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef012af480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5838:1875706322691328:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788813184.323581:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ecfdf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813184.326036:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308024960 00000100:00100000:1.0:1788813184.326057:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308024960 00010000:00010000:1.0:1788813184.326121:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ecf84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d4e expref: 48 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813184.326180:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:1.0:1788813184.326192:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+48:2366:x1875706308024960:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813184.326211:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813184.326220:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ecf84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d4e expref: 48 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.326236:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ecf84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d4e expref: 48 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.326266:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ecf84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d4e expref: 48 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.326286:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef1a079d00) 00010000:00010000:1.0:1788813184.326292:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ecfdf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.326303:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ecfdf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.326313:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ecfdf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.326386:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813184.326472:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+47:2366:x1875706308024960:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 282us (3041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813184.326480:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 78 00010000:00010000:0.0:1788813184.327153:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ecfdf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.327166:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ecfdf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788813184.327318:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788813184.328264:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1788813184.328422:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b04e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1875706322691456:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788813184.328603:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813184.328645:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee066bb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813184.328700:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322691456 00000100:00100000:2.0:1788813184.328710:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322691456 00000100:00100000:2.0:1788813184.328819:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788813184.328837:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5838:x1875706322691456:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788813184.328936:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5838:x1875706322691456:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 109us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813184.328944:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788813184.329049:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813184.330446:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b04e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1875706322691456:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788813184.331069:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1788813184.331253:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b04e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1875706322691584:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788813184.331324:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813184.331360:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee066bbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813184.331488:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322691584 00000100:00100000:2.0:1788813184.331506:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322691584 00000100:00100000:2.0:1788813184.331573:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788813184.331583:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5838:x1875706322691584:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788813184.331933:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5838:x1875706322691584:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 349us (607us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788813184.331942:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788813184.332065:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b04e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1875706322691584:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788813184.332124:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1788813184.332168:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ecfdf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.332180:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ecfdf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.332187:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ecfdf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.332192:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214c600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813184.332198:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ecfdf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.332206:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ecfdf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.332224:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef1a079d00) 00010000:00010000:0.0:1788813184.332227:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788813184.332232:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ecfdf lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.332239:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ecfdf lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788813184.332451:0:5838:0:(mdd_object.c:4199:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788813184.332570:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1788813184.332583:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 344718801238ns, next at 345718798131ns, rc = 0 00000001:00080000:0.0:1788813184.332590:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1788813184.332632:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef1a079d00) 00010000:00010000:0.0:1788813184.332636:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788813184.332647:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd000/0x1b294f297b1ecfca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d71 expref: 51 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813184.333809:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef0e7fac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+50:11584:x1875706308024832:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 14732us (15050us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1788813184.333823:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00000020:00080000:0.0:1788813184.333830:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788813184.339507:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813184.339631:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308025088 00000100:00100000:3.0:1788813184.339645:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308025088 00000100:00100000:3.0:1788813184.339730:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 202 00000100:00100000:3.0:1788813184.339743:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+50:11584:x1875706308025088:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813184.339777:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813184.339858:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ecfe6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2d78 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.339953:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ecfe6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d78 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.339971:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ecfe6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d78 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.339991:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:3.0:1788813184.339995:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813184.340000:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef4214cc00, rc 0) 00000100:00100000:3.0:1788813184.340064:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+51:11584:x1875706308025088:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 324us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813184.340092:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 202 00000100:00100000:3.0:1788813184.346456:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813184.346548:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308025344 00000100:00100000:0.0:1788813184.346562:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308025344 00000100:00100000:0.0:1788813184.346645:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:0.0:1788813184.346657:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef012af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+51:11584:x1875706308025344:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1788813184.347006:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef012af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+52:11584:x1875706308025344:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 350us (563us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1788813184.347014:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:2.0:1788813184.453709:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813184.453945:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308025472 00000100:00100000:0.0:1788813184.453958:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308025472 00000100:00100000:0.0:1788813184.454093:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 203 00000100:00100000:0.0:1788813184.454105:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+52:11594:x1875706308025472:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:0.0:1788813184.454207:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecfed lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454228:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecfed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454242:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecfed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454277:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ecff4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454285:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ecff4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454292:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ecff4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454487:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ecffb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454497:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ecffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454505:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ecffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813184.454565:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ecffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454593:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecfed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454601:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecfed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454616:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecfed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454623:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cee00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813184.454628:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecfed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454644:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecfed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454667:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:0.0:1788813184.454670:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813184.454676:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecfed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454682:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ecfed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454700:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ecff4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454706:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ecff4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454712:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ecff4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454718:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cec00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813184.454721:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ecff4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454728:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ecff4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454735:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ef1a079d00) 00010000:00010000:0.0:1788813184.454738:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813184.454741:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ecff4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454756:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ecff4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454771:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ecffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454778:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ecffb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454899:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ecffb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454905:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190ce800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813184.454908:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ecffb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454913:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ecffb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454922:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:0.0:1788813184.454925:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813184.454928:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ecffb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.454934:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ecffb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813184.455041:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+52:11594:x1875706308025472:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 937us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813184.455050:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 203 00000100:00100000:1.0:1788813184.491594:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813184.492086:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308025728 00000100:00100000:3.0:1788813184.492101:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308025728 00000100:00100000:3.0:1788813184.492233:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 204 00000100:00100000:3.0:1788813184.492248:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+52:11597:x1875706308025728:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813184.492278:0:8565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813184.492308:0:8565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1ed002 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2d7f expref: -99 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.492427:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ed009 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.492448:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ed009 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.492463:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ed009 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.492481:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ed010 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.492489:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ed010 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.492497:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ed010 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.492671:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed017 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.492708:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.492716:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813184.492728:0:8565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788813184.493217:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ed009 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.493228:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ed009 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.493236:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ed009 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.493242:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214c600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813184.493247:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ed009 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.493255:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ed009 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.493269:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:3.0:1788813184.493272:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813184.493278:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ed009 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.493285:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ed009 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.493301:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ed010 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.493315:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ed010 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.493321:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ed010 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.493325:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214d000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813184.493328:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ed010 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.493438:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ed010 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.493448:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ef077b4a00) 00010000:00010000:3.0:1788813184.493450:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813184.493454:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ed010 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.493460:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ed010 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.493520:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1ed002 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d7f expref: 55 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.493536:0:8565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed017 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d7f expref: 54 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.493543:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:3.0:1788813184.493546:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813184.493556:0:8565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef01517200, rc 0) 00000100:00100000:3.0:1788813184.494457:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+54:11597:x1875706308025728:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 2203us (2867us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788813184.494472:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 204 00000100:00100000:2.0:1788813184.497500:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813184.497599:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308025856 00000100:00100000:0.0:1788813184.497611:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308025856 00000100:00100000:0.0:1788813184.497684:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 205 00000100:00100000:0.0:1788813184.497694:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+54:11597:x1875706308025856:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:0.0:1788813184.497980:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ed025 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.498002:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ed025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.498017:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ed025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.498054:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ed025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.498062:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ed025 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.498069:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ed025 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.498077:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190ce800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813184.498082:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ed025 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.498092:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ed025 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.498106:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:0.0:1788813184.498109:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788813184.498116:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ed025 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.498143:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ed025 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813184.498456:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+54:11597:x1875706308025856:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 760us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813184.498467:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 205 00000100:00100000:2.0:1788813184.501665:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813184.502105:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308026112 00000100:00100000:0.0:1788813184.502121:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308026112 00000100:00100000:0.0:1788813184.502223:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:0.0:1788813184.502235:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+54:11597:x1875706308026112:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1788813184.502664:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+55:11597:x1875706308026112:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 429us (1009us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788813184.502672:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:2.0:1788813184.580222:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813184.580826:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308026368 00000100:00100000:0.0:1788813184.580840:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308026368 00000100:00100000:0.0:1788813184.580923:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 206 00000100:00100000:0.0:1788813184.580934:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+55:11607:x1875706308026368:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788813184.580968:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813184.580972:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788813184.581004:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ecfa7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d63 expref: 55 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.581026:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:0.0:1788813184.581032:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813184.581050:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ed02c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2d86 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.581204:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ed033 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.581222:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed017 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d7f expref: 55 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.581232:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ed033 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.581278:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed017 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d7f expref: 55 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.581294:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed017 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d7f expref: 55 pid: 8565 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813184.581313:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b07480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875706322691712:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788813184.581460:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee066bbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788813184.586861:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b07480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1875706322691712:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788813184.586904:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ed033 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813184.589104:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813184.589206:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308026496 00000100:00100000:3.0:1788813184.589218:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308026496 00010000:00010000:3.0:1788813184.589268:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed017 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d7f expref: 56 pid: 8565 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813184.589320:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:3.0:1788813184.589331:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36add880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+56:2365:x1875706308026496:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813184.589361:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813184.589377:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed017 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d7f expref: 56 pid: 8565 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.589392:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed017 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d7f expref: 56 pid: 8565 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.589419:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed017 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d7f expref: 56 pid: 8565 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.589451:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:3.0:1788813184.589457:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ed033 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.589469:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ed033 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.589477:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ed033 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.589533:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813184.589605:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36add880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+55:2365:x1875706308026496:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 275us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813184.589614:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 79 00010000:00010000:0.0:1788813184.589765:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ed033 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.589823:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ed033 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813184.589859:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788813184.590055:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ed02c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d86 expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.590074:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ed033 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d86 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.590083:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:0.0:1788813184.590086:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788813184.590088:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cec00, rc 0) 00000100:00100000:0.0:1788813184.590118:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+55:11607:x1875706308026368:12345-192.168.203.13@tcp:101:bash.0 Request processed in 9187us (9912us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788813184.590126:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 206 00000100:00100000:2.0:1788813184.594054:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813184.594130:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308026752 00000100:00100000:3.0:1788813184.594143:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308026752 00000100:00100000:3.0:1788813184.594210:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 207 00000100:00100000:3.0:1788813184.594220:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+55:11607:x1875706308026752:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:3.0:1788813184.594558:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516e00/0x1b294f297b1ed041 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.594582:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516e00/0x1b294f297b1ed041 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.594596:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516e00/0x1b294f297b1ed041 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788813184.594653:0:8565:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1788813184.594677:0:8565:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c408b24c reply state 00000000a201614b transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516e00/0x1b294f297b1ed041 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813184.594687:0:8565:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788813184.595050:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+58:11607:x1875706308026752:12345-192.168.203.13@tcp:36:bash.0 Request processed in 829us (1007us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788813184.595059:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 207 00000020:00080000:3.0:1788813184.595065:0:8565:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788813184.599336:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516e00/0x1b294f297b1ed041 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.599360:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516e00/0x1b294f297b1ed041 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.599377:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516e00/0x1b294f297b1ed041 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.599385:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef01516e00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813184.599391:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516e00/0x1b294f297b1ed041 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.599400:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516e00/0x1b294f297b1ed041 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.599420:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:1.0:1788813184.599423:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813184.599429:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516e00/0x1b294f297b1ed041 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.599436:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516e00/0x1b294f297b1ed041 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813184.599538:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813184.599633:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308026880 00000100:00100000:0.0:1788813184.599647:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308026880 00000100:00100000:0.0:1788813184.599745:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 208 00000100:00100000:0.0:1788813184.599757:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+57:11607:x1875706308026880:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788813184.599910:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813184.599931:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ed048 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2d8d expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.600027:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ed04f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.600042:0:7630:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ed033 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d86 expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.600052:0:7630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ed04f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.600111:0:7630:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ed033 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d86 expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.600126:0:7630:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ed033 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d86 expref: 58 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813184.600143:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b07480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7630:1875706322691840:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788813184.600234:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee066bb600 going to sleep for 11 seconds 00000100:00100000:2.0:1788813184.603340:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813184.603426:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308027008 00000100:00100000:1.0:1788813184.603445:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308027008 00010000:00010000:1.0:1788813184.603500:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ed033 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d86 expref: 59 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813184.603551:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:1.0:1788813184.603562:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3658aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+59:2365:x1875706308027008:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813184.603581:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813184.603589:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ed033 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d86 expref: 59 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.603614:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ed033 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d86 expref: 59 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.603643:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:1.0:1788813184.603650:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ed04f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.603661:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ed04f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.603671:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ed04f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.603696:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813184.603763:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3658aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+59:2365:x1875706308027008:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 202us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813184.603820:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 80 00010000:00010000:0.0:1788813184.605338:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ed033 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d86 expref: 58 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813184.605377:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b07480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7630:1875706322691840:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788813184.605408:0:7630:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ed04f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.605421:0:7630:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ed04f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.605428:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ed04f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813184.605490:0:7630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788813184.605495:0:7630:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788813184.605522:0:7630:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ed04f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.605564:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ed048 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d8d expref: 58 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.605657:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ed04f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d8d expref: 57 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.605668:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:0.0:1788813184.605671:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813184.605676:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190ce200, rc 0) 00000100:00100000:0.0:1788813184.605824:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+57:11607:x1875706308026880:12345-192.168.203.13@tcp:101:bash.0 Request processed in 6068us (6292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813184.605835:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 208 00000100:00100000:2.0:1788813184.613409:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813184.613707:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308027264 00000100:00100000:3.0:1788813184.613722:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308027264 00000100:00100000:0.0:1788813184.613951:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:0.0:1788813184.613966:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+57:11607:x1875706308027264:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:0.0:1788813184.614283:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+58:11607:x1875706308027264:12345-192.168.203.13@tcp:35:bash.0 Request processed in 321us (887us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788813184.614291:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:1.0:1788813184.685668:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813184.685883:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308027392 00000100:00100000:0.0:1788813184.685898:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308027392 00000100:00100000:0.0:1788813184.686021:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 209 00000100:00100000:0.0:1788813184.686034:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+58:11613:x1875706308027392:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813184.686068:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813184.686096:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ed056 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2d94 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.686181:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ed05d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.686224:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ed05d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.686241:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ed05d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813184.686292:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788813184.686297:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788813184.686321:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ed05d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.686353:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cee00/0x1b294f297b1ed056 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d94 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.686385:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ed05d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d94 expref: 59 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.686396:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:0.0:1788813184.686400:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788813184.686404:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cec00, rc 0) 00000100:00100000:0.0:1788813184.686493:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+59:11613:x1875706308027392:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 461us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813184.686501:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 209 00000100:00100000:3.0:1788813184.688983:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813184.690218:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308027520 00000100:00100000:0.0:1788813184.690233:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308027520 00000100:00100000:0.0:1788813184.690351:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 210 00000100:00100000:0.0:1788813184.690372:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef012ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+59:11613:x1875706308027520:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813184.690398:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813184.690437:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ed064 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2d9b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.690523:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1ed06b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.690542:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1ed06b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.690556:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1ed06b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.690585:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ed072 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.690594:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ed072 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.690601:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ed072 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.690719:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ed079 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.690728:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ed079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.690735:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ed079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813184.691012:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788813184.691018:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788813184.691044:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ed079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.691070:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ed079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.691079:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1ed06b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.691086:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1ed06b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.691094:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1ed06b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.691102:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cf200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813184.691108:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1ed06b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.691117:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1ed06b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.691132:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:0.0:1788813184.691136:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813184.691141:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1ed06b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.691148:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1ed06b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.691164:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ed072 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.691171:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ed072 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.691187:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ed072 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.691192:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190ce600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813184.691196:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ed072 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.691203:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ed072 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.691211:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ef1a079d00) 00010000:00010000:0.0:1788813184.691214:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813184.691217:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ed072 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.691223:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ed072 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.691263:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ed064 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d9b expref: 61 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.691280:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ed079 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d9b expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.691288:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:0.0:1788813184.691290:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813184.691293:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cfe00, rc 0) 00000100:00100000:0.0:1788813184.691395:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef012ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+60:11613:x1875706308027520:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1033us (2424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813184.691414:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 210 00000100:00100000:2.0:1788813184.695892:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813184.695960:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813184.696151:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308027776 00000100:00100000:0.0:1788813184.696163:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308027776 00000100:00100000:0.0:1788813184.696224:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 211 00000100:00100000:0.0:1788813184.696236:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+60:11613:x1875706308027776:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813184.696265:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813184.696291:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ed080 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2da2 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.696478:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ed087 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.696496:0:7630:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ed04f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d8d expref: 61 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.696505:0:7630:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ed079 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d9b expref: 61 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.696515:0:7630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ed087 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.696561:0:7630:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ed079 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d9b expref: 61 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.696578:0:7630:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ed079 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d9b expref: 61 pid: 5835 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813184.696593:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b07480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7630:1875706322691968:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788813184.697045:0:7630:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ed04f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d8d expref: 61 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.697056:0:7630:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ed04f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d8d expref: 61 pid: 7630 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813184.697067:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b05180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7630:1875706322692096:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788813184.697100:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee066bb600 going to sleep for 11 seconds 00000100:00100000:3.0:1788813184.697314:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308027904 00000100:00100000:3.0:1788813184.697321:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308027904 00010000:00010000:3.0:1788813184.697352:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ed079 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d9b expref: 62 pid: 5835 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813184.697430:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:3.0:1788813184.697439:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36588e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+62:2363:x1875706308027904:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813184.697450:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813184.697457:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ed079 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d9b expref: 62 pid: 5835 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.697471:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ed079 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d9b expref: 62 pid: 5835 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.697494:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:3.0:1788813184.697500:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ed087 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.697508:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ed087 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813184.697514:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813184.697548:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36588e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+62:2363:x1875706308027904:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 108us (1587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813184.697555:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:1.0:1788813184.701532:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00010000:00010000:0.0:1788813184.701859:0:7630:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.13@tcp) returned -22 from blocking AST (req@000000001fff35cc x1875706322691968) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ed079 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d9b expref: 61 pid: 5835 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.701888:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfe00/0x1b294f297b1ed079 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d9b expref: 61 pid: 5835 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813184.701911:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b07480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7630:1875706322691968:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788813184.701926:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b05180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7630:1875706322692096:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788813184.701959:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:0.0:1788813184.701965:0:7630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ed087 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.701976:0:7630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ed087 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.701987:0:7630:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ed087 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813184.702078:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308028032 00000100:00100000:2.0:1788813184.702088:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308028032 00010000:00010000:2.0:1788813184.702135:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ed04f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d8d expref: 61 pid: 7630 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813184.702174:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:2.0:1788813184.702185:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef121e4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+61:2365:x1875706308028032:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813184.702202:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813184.702208:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ed04f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d8d expref: 61 pid: 7630 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.702220:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ed04f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d8d expref: 61 pid: 7630 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.702243:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce200/0x1b294f297b1ed04f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d8d expref: 61 pid: 7630 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.702254:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:2.0:1788813184.702258:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ed087 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.702277:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ed087 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.702286:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ed087 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813184.702317:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813184.702395:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef121e4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+60:2365:x1875706308028032:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 211us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813184.702403:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 82 00010000:00010000:0.0:1788813184.702539:0:7630:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ed087 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.702556:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ed087 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813184.702580:0:7630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788813184.702770:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf000/0x1b294f297b1ed080 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2da2 expref: 61 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.702817:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ed087 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2da2 expref: 60 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.702826:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:0.0:1788813184.702829:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788813184.702832:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cea00, rc 0) 00000100:00100000:0.0:1788813184.702861:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+60:11613:x1875706308027776:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 6628us (6985us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788813184.702868:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 211 00000100:00100000:2.0:1788813184.707701:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813184.708125:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308028288 00000100:00100000:1.0:1788813184.708138:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308028288 00000100:00100000:1.0:1788813184.708247:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:1.0:1788813184.708258:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3658aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+60:11613:x1875706308028288:12345-192.168.203.13@tcp:103:lfs.0 00010000:00010000:1.0:1788813184.708279:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813184.708307:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214cc00/0x1b294f297b1ecfe6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d78 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813184.708329:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:1.0:1788813184.708335:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813184.708417:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3658aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c560788-da9a-41fd-952d-091d96dace11+59:11613:x1875706308028288:12345-192.168.203.13@tcp:103:lfs.0 Request processed in 160us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813184.708424:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:2.0:1788813184.710481:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813184.710553:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308028416 00000100:00100000:0.0:1788813184.710564:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308028416 00000100:00100000:0.0:1788813184.710634:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 212 00000100:00100000:0.0:1788813184.710645:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+59:11613:x1875706308028416:12345-192.168.203.13@tcp:58:lfs.0 00010000:00010000:0.0:1788813184.710761:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ed095 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.710831:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ed095 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.710845:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ed095 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788813184.711110:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788813184.711206:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+59:11613:x1875706308028416:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 562us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813184.711215:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 212 00000100:00100000:3.0:1788813184.713427:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813184.713509:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308028544 00000100:00100000:0.0:1788813184.713520:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308028544 00000100:00100000:0.0:1788813184.713585:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 213 00000100:00100000:0.0:1788813184.713595:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef012ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+59:11613:x1875706308028544:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813184.713627:0:8565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813184.713651:0:8565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ed09c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2da9 expref: -99 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.713716:0:8565:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ed095 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.713727:0:8565:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ed09c lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2da9 expref: 60 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.713748:0:8565:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ed095 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.713761:0:8565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ed09c lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2da9 expref: 60 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.713820:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:0.0:1788813184.713823:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788813184.713828:0:8565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ed09c lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2da9 expref: 60 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813184.713854:0:8565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190ce600, rc 0) 00000100:00100000:0.0:1788813184.714409:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef012ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+60:11613:x1875706308028544:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 813us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813184.714418:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 213 00010000:00010000:0.0:1788813184.989813:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788813185.181147:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813185.181171:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813185.181241:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788813185.181250:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788813185.181423:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b05180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1875706322692224:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788813185.181576:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee066bb600 going to sleep for 11 seconds 00000100:00100000:3.0:1788813185.188096:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813185.188140:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308028672 00000100:00100000:1.0:1788813185.188506:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b05180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1875706322692224:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788813185.191830:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308028672 00000100:00100000:3.0:1788813185.191955:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 214 00000100:00100000:3.0:1788813185.191968:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef363d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+60:11614:x1875706308028672:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788813185.192009:0:7630:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788813185.192185:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef363d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+60:11614:x1875706308028672:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 219us (4098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813185.192194:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 214 00000100:00100000:1.0:1788813185.199704:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813185.199768:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308028800 00000100:00100000:1.0:1788813185.199802:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308028800 00000100:00100000:1.0:1788813185.199869:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 215 00000100:00100000:1.0:1788813185.199881:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+60:11614:x1875706308028800:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788813185.199973:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ed0a3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.199994:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ed0a3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200008:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ed0a3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200047:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed0aa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200056:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed0aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200063:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed0aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200090:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd400/0x1b294f297b1ed0b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200099:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd400/0x1b294f297b1ed0b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200106:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd400/0x1b294f297b1ed0b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813185.200153:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788813185.200158:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813185.200172:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd400/0x1b294f297b1ed0b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200184:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ed0a3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200191:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ed0a3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200198:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ed0a3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200215:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fc800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813185.200220:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ed0a3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200228:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ed0a3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200242:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ef077b4200) 00010000:00010000:1.0:1788813185.200245:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813185.200251:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ed0a3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200257:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc800/0x1b294f297b1ed0a3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200272:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed0aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200278:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed0aa lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200285:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed0aa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200290:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fcc00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813185.200293:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed0aa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200299:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed0aa lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200319:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff93ef19f1f100) 00010000:00010000:1.0:1788813185.200322:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813185.200325:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed0aa lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200332:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed0aa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200348:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd400/0x1b294f297b1ed0b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200355:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd400/0x1b294f297b1ed0b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200374:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd400/0x1b294f297b1ed0b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200379:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fd400 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813185.200383:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd400/0x1b294f297b1ed0b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200389:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd400/0x1b294f297b1ed0b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200397:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:1.0:1788813185.200400:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813185.200404:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd400/0x1b294f297b1ed0b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.200410:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd400/0x1b294f297b1ed0b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813185.201052:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+60:11614:x1875706308028800:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 1164us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813185.201063:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 215 00000100:00100000:2.0:1788813185.209354:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813185.211719:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308029056 00000100:00100000:3.0:1788813185.211741:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308029056 00000100:00100000:3.0:1788813185.212771:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 216 00000100:00100000:3.0:1788813185.212815:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3658a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+60:11614:x1875706308029056:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813185.212843:0:8565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813185.212871:0:8565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed0b8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2db0 expref: -99 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.212996:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed0bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.213014:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed0bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.213033:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed0bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813185.213047:0:8565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788813185.213168:0:8565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed0bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.213177:0:8565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed0bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.213196:0:8565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed0bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.213202:0:8565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef01517800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813185.213208:0:8565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed0bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.213217:0:8565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed0bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.213231:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:3.0:1788813185.213235:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788813185.213241:0:8565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed0bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.213249:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed0bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.213309:0:8565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed0b8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2db0 expref: 62 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.213324:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ef077b4200) 00010000:00010000:3.0:1788813185.213327:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813185.213331:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed0b8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2db0 expref: 62 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.213340:0:8565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef01517200, rc 0) 00000100:00100000:3.0:1788813185.213439:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3658a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+61:11614:x1875706308029056:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 655us (4097us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1788813185.213457:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 216 00000100:00100000:2.0:1788813185.218992:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813185.219078:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308029184 00000100:00100000:3.0:1788813185.219092:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308029184 00000100:00100000:3.0:1788813185.219170:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 217 00000100:00100000:3.0:1788813185.219183:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+61:11614:x1875706308029184:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788813185.219233:0:7630:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788813185.219385:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+61:11614:x1875706308029184:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 204us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813185.219395:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 217 00000100:00100000:1.0:1788813185.237144:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813185.237212:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308029440 00000100:00100000:1.0:1788813185.237224:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308029440 00000100:00100000:1.0:1788813185.237293:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 218 00000100:00100000:1.0:1788813185.237305:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+61:11614:x1875706308029440:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813185.237334:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813185.237338:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788813185.237384:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cec00/0x1b294f297b1ed05d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d94 expref: 61 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.237408:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:1.0:1788813185.237417:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788813185.237434:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd400/0x1b294f297b1ed0cd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2db7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788813185.238017:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1788813185.238271:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed0d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.238290:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.238303:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.238406:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd400/0x1b294f297b1ed0cd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2db7 expref: 63 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.238427:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed0d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2db7 expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.238435:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93ef19f1f100) 00010000:00010000:1.0:1788813185.238437:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813185.238440:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fcc00, rc 0) 00000100:00100000:1.0:1788813185.238532:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+62:11614:x1875706308029440:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1227us (1402us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788813185.238543:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 218 00000100:00100000:2.0:1788813185.256522:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813185.256709:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308029696 00000100:00100000:3.0:1788813185.256722:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308029696 00000100:00100000:3.0:1788813185.256833:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 219 00000100:00100000:3.0:1788813185.256847:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+62:11614:x1875706308029696:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788813185.256924:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813185.256968:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed0d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2db7 expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.256991:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93ef19f1f100) 00010000:00010000:3.0:1788813185.257007:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813185.257033:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed0e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.257049:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed0e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.257061:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed0e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.257414:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed0e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xe814138 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.257425:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed0e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe814138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.257433:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed0e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe814138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.257498:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed0e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.257505:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed0e2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.257512:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed0e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.257519:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef01517200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813185.257524:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed0e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.257532:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed0e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.257541:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:3.0:1788813185.257544:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813185.257549:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed0e2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.257556:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed0e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.257578:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed0e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe814138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.257586:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed0e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe814138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.257592:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed0e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe814138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.257598:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef01517800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813185.257601:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed0e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe814138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.257608:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed0e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe814138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.257616:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xe814138 (ffff93ef077b4b00) 00010000:00010000:3.0:1788813185.257618:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813185.257621:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed0e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe814138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.257627:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed0e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe814138 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813185.257726:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+61:11614:x1875706308029696:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 882us (1216us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788813185.257734:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 219 00000100:00100000:1.0:1788813185.263114:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813185.263166:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308029824 00000100:00100000:1.0:1788813185.263179:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308029824 00000100:00100000:1.0:1788813185.263243:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 220 00000100:00100000:1.0:1788813185.263255:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+61:11614:x1875706308029824:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813185.263284:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813185.263312:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ed0f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2dbe expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.263357:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ed0f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.263383:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ed0f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.263412:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ed0f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.263533:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ed0f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dbe expref: 63 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.263558:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ed0f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dbe expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.263568:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93ef19f1fc00) 00010000:00010000:1.0:1788813185.263572:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788813185.263577:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fc400, rc 0) 00000100:00100000:1.0:1788813185.263649:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+62:11614:x1875706308029824:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 395us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813185.263657:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 220 00000100:00100000:1.0:1788813185.271522:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813185.271575:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308030080 00000100:00100000:1.0:1788813185.271590:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308030080 00000100:00100000:1.0:1788813185.271666:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 221 00000100:00100000:1.0:1788813185.271680:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+62:11614:x1875706308030080:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788813185.271832:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ed0fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.271855:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ed0fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.271871:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ed0fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788813185.274712:0:8565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1788813185.274732:0:8565:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 345660949633ns, next at 346660945764ns, rc = 0 00000004:00010000:1.0:1788813185.274894:0:8565:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b5455d1 reply state 00000000c7731591 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ed0fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813185.274909:0:8565:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788813185.276638:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+64:11614:x1875706308030080:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 4944us (5115us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788813185.276655:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 221 00010000:00010000:3.0:1788813185.280453:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ed0fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.280495:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ed0fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.280504:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ed0fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.280512:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fdc00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813185.280518:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ed0fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.280526:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ed0fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.280548:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93ef19f1fc00) 00010000:00010000:3.0:1788813185.280552:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788813185.280558:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ed0fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.280565:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ed0fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813185.284935:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813185.286144:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308030208 00000100:00100000:3.0:1788813185.286163:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308030208 00000100:00100000:3.0:1788813185.286241:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 222 00000100:00100000:3.0:1788813185.286253:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+63:11614:x1875706308030208:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813185.286286:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813185.286314:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed105 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2dc5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.286427:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed105 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dc5 expref: 64 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.286445:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed105 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dc5 expref: 64 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.286468:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93ef19f1fc00) 00010000:00010000:3.0:1788813185.286472:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813185.286478:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef01517800, rc 0) 00000100:00100000:3.0:1788813185.286557:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c560788-da9a-41fd-952d-091d96dace11+64:11614:x1875706308030208:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 306us (1636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813185.286565:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 222 00000001:00080000:2.0:1788813185.291525:0:6700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1788813185.291556:0:6700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1788813185.296582:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813185.296891:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308030336 00000100:00100000:0.0:1788813185.296905:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308030336 00000100:00100000:0.0:1788813185.297276:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:0.0:1788813185.297289:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3658b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+9:2365:x1875706308030336:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788813185.297687:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3658b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+10:2365:x1875706308030336:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 398us (1118us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788813185.297697:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:3.0:1788813185.302333:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813185.302468:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308030592 00000100:00100000:0.0:1788813185.302481:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308030592 00000100:00100000:0.0:1788813185.302559:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:0.0:1788813185.302573:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef363d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+64:11614:x1875706308030592:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788813185.303057:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef363d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+65:11614:x1875706308030592:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 484us (736us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788813185.303203:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00080000:1.0:1788813185.304595:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813185.310430:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813185.312074:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308030848 00000100:00100000:1.0:1788813185.312093:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308030848 00000100:00100000:1.0:1788813185.312184:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 223 00000100:00100000:1.0:1788813185.312196:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+65:11614:x1875706308030848:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788813185.312356:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+65:11614:x1875706308030848:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 162us (1940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813185.312374:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 223 00000100:00100000:2.0:1788813185.317640:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813185.318244:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308030976 00000100:00100000:1.0:1788813185.318260:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308030976 00000100:00100000:2.0:1788813185.322358:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 224 00000100:00100000:2.0:1788813185.322395:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+65:11614:x1875706308030976:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813185.322426:0:8565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813185.322455:0:8565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed10c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2dcc expref: -99 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.322550:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ed113 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.322586:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ed113 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.322602:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ed113 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813185.322648:0:8565:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788813185.322671:0:8565:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ed113 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.322704:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed10c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dcc expref: 67 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.322727:0:8565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ed113 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dcc expref: 66 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.322736:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93ef19f1fc00) 00010000:00010000:2.0:1788813185.322739:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788813185.322744:0:8565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619000, rc 0) 00000100:00100000:2.0:1788813185.322885:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+66:11614:x1875706308030976:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 503us (5260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813185.322895:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 224 00000100:00100000:3.0:1788813185.328511:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813185.328690:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308031104 00000100:00100000:2.0:1788813185.328705:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308031104 00000100:00100000:2.0:1788813185.328829:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:2.0:1788813185.328842:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36176d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+10:2365:x1875706308031104:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813185.328866:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813185.328905:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed11a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2dd3 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788813185.328956:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f1f81, blocks: 0x1 00010000:00010000:2.0:1788813185.328986:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788813185.328991:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813185.329004:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed11a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dd3 expref: 11 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.329038:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed11a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dd3 expref: 11 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.329055:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619200, rc 0) 00000100:00100000:2.0:1788813185.329504:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36176d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+11:2365:x1875706308031104:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 660us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813185.329515:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:0.0:1788813185.343747:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813185.345152:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308031360 00000100:00100000:1.0:1788813185.345171:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308031360 00000100:00100000:1.0:1788813185.345268:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 225 00000100:00100000:1.0:1788813185.345281:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+66:11614:x1875706308031360:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788813185.345452:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+66:11614:x1875706308031360:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 174us (1719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813185.345461:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 225 00000100:00100000:1.0:1788813185.362722:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813185.362841:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308031488 00000100:00100000:2.0:1788813185.362855:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308031488 00000100:00100000:2.0:1788813185.362934:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:2.0:1788813185.362946:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+11:11614:x1875706308031488:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813185.362976:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813185.362999:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f70e8a67/0x1b294f297b1ed121 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2dda expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.363038:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed11a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dd3 expref: 12 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.363071:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813185.363076:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813185.363082:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f70e8a67/0x1b294f297b1ed121 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dda expref: 12 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.363123:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed11a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dd3 expref: 12 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.363138:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed11a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dd3 expref: 12 pid: 6675 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813185.363155:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36588a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6676:1875706322692352:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788813185.363272:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef21238cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813185.385440:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813185.385507:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36588a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6676:1875706322692352:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788813185.385545:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f70e8a67/0x1b294f297b1ed121 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dda expref: 12 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.385566:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21618a00, rc 0) 00000100:00100000:2.0:1788813185.385630:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+12:11614:x1875706308031488:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 22686us (22922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813185.385639:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:1.0:1788813185.387209:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308031616 00000100:00100000:1.0:1788813185.387229:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308031616 00010000:00010000:1.0:1788813185.387290:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed11a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dd3 expref: 12 pid: 6675 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813185.387355:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:1.0:1788813185.387377:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+12:2366:x1875706308031616:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813185.387395:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813185.387425:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed11a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dd3 expref: 12 pid: 6675 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.387440:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed11a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dd3 expref: 12 pid: 6675 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.387468:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed11a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dd3 expref: 12 pid: 6675 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.387490:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813185.387495:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813185.387506:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f70e8a67/0x1b294f297b1ed121 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dda expref: 11 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.387518:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f70e8a67/0x1b294f297b1ed121 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dda expref: 11 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.387598:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f70e8a67/0x1b294f297b1ed121 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dda expref: 11 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813185.388654:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee07d1e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5820:1875706322692480:192.168.203.13@tcp:105: 00000100:00100000:1.0:1788813185.388853:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee066bb480 going to sleep for 11 seconds 00000100:00100000:0.0:1788813185.401901:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813185.403731:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308031744 00000100:00100000:1.0:1788813185.403749:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308031744 00002000:00100000:1.0:1788813185.403885:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff93ef36b07100 x1875706308031744/t0(0) o4->9c560788-da9a-41fd-952d-091d96dace11@192.168.203.13@tcp:1/0 lens 504/0 e 0 to 0 dl 1788813196 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788813185.403899:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93ef36b07100 with x1875706308031744 ext(0->12) 00002000:00010000:1.0:1788813185.403907:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ef36b07100 00000100:00100000:1.0:1788813185.403947:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:1.0:1788813185.403958:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9c560788-da9a-41fd-952d-091d96dace11+12:2365:x1875706308031744:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788813185.404545:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9c560788-da9a-41fd-952d-091d96dace11+14:2365:x1875706308031744:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 Request processed in 584us (2655us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788813185.404555:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00002000:00100000:1.0:1788813185.404565:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff93ef36b07100 x1875706308031744/t4294967320(0) o4->9c560788-da9a-41fd-952d-091d96dace11@192.168.203.13@tcp:1/0 lens 504/448 e 0 to 0 dl 1788813196 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788813185.404575:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93ef36b07100 with x1875706308031744 ext(0->12) 00002000:00010000:1.0:1788813185.404579:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ef36b07100 00000100:00100000:0.0:1788813185.408455:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813185.408648:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308031872 00000100:00100000:2.0:1788813185.408663:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308031872 00000100:00100000:2.0:1788813185.408746:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 226 00000100:00100000:2.0:1788813185.408768:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+66:11614:x1875706308031872:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788813185.409280:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee07d1e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5820:1875706322692480:192.168.203.13@tcp:105: 00010000:00010000:1.0:1788813185.409311:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813185.409413:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+13:2366:x1875706308031616:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 22038us (23982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813185.409426:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 83 00000001:00080000:1.0:1788813185.460451:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1788813185.460495:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1788813185.460527:0:5856:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93ee066bb0c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788813185.460534:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ef35a34600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93ee066bb9c0 00000020:00080000:1.0:1788813185.460537:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ef35a34300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93ef36d03800 00000004:00080000:1.0:1788813185.460568:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:1.0:1788813185.460596:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1788813185.460653:0:5856:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93ef370fa480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788813185.460656:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ee04942900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93ef370fa3c0 00000020:00080000:1.0:1788813185.460659:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ee04942f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93ef2101b000 00000020:00080000:1.0:1788813185.460680:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788813185.461243:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788813185.461424:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee07d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322692736:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788813185.461515:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813185.461597:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813185.461603:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee07d1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322692608:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788813185.461628:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813185.461664:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322692736 00000100:00100000:1.0:1788813185.461674:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322692736 00000100:00100000:1.0:1788813185.461743:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322692608 00000100:00100000:1.0:1788813185.461746:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322692608 00000100:00100000:2.0:1788813185.461990:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322692864:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788813185.462028:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813185.462499:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+20:11614:x1875706308031872:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 53727us (54051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813185.462511:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 226 00000100:00100000:1.0:1788813185.462588:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788813185.462603:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3302:x1875706322692736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788813185.465901:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00080000:2.0:1788813185.466011:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813185.466038:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322692864 00000100:00100000:2.0:1788813185.466050:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322692864 00000100:00100000:2.0:1788813185.466112:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308032000 00000100:00100000:2.0:1788813185.466115:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308032000 00000100:00100000:2.0:1788813185.466135:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788813185.466146:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3302:x1875706322692608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788813185.466185:0:8122:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1788813185.466217:0:8122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed128 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.466242:0:8122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1eceea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d39 expref: 13 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.466251:0:8122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788813185.466255:0:8122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813185.466260:0:8122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed128 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.466300:0:8122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1eceea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d39 expref: 13 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.466316:0:8122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1eceea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d39 expref: 13 pid: 6676 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813185.466369:0:8122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3658b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8122:1875706322692992:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788813185.466491:0:8122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef21238cc0 going to sleep for 11 seconds 00002000:00010000:1.0:1788813185.469445:0:6675:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788813185.469457:0:6675:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788813185 00002000:00010000:1.0:1788813185.469460:0:6675:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788813185.469463:0:6675:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788813185 -> 1788813185 00002000:00010000:1.0:1788813185.469465:0:6675:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788813185.469548:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3302:x1875706322692736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 6945us (8028us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788813185.469561:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788813185.469603:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788813185.469617:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3658b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322692864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788813185.469655:0:6675:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1788813185.469690:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f1f80, atime: 0x6a9f1f80, ctime: 0x6a9f1f80, blocks: 0xb 00010000:00010000:1.0:1788813185.469698:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f535b6d4/0x1b294f297b1ed12f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.469717:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=345s v=(0 0) 00010000:00010000:1.0:1788813185.469722:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813185.469731:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f535b6d4/0x1b294f297b1ed12f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.469751:0:6675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f535b6d4/0x1b294f297b1ed12f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.469764:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f535b6d4/0x1b294f297b1ed12f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788813185.469939:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ee07d1df80/2, rc 0, transno 4294967321 00000100:00100000:0.0:1788813185.469948:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee07d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322692736:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788813185.470027:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f535b6d4/0x1b294f297b1ed12f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.470090:0:6675:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788813185.470729:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3658b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1875706322692864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1116us (8698us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788813185.470739:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788813185.470769:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:1.0:1788813185.470833:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+13:2363:x1875706308032000:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788813185.472524:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1788813185.472537:0:3299:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967309 00000004:00080000:3.0:1788813185.472561:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ef36160700, transno 4294967307 00000004:00080000:3.0:1788813185.472593:0:3299:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:3.0:1788813185.472729:0:3299:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff93ef36588a80 x1875706322692864/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788813201 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788813185.472909:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ef36588a80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788813185.472917:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322692864:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788813185.473227:0:8122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3658b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8122:1875706322692992:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788813185.473253:0:8122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed128 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813185.478481:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813185.478986:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308032128 00000100:00100000:3.0:1788813185.479000:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308032128 00010000:00010000:3.0:1788813185.479961:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1eceea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d39 expref: 14 pid: 6676 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813185.480029:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:3.0:1788813185.480046:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3658b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+14:2364:x1875706308032128:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813185.480165:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813185.480176:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f535b6d4/0x1b294f297b1ed12f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.480188:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fd200 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813185.480195:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f535b6d4/0x1b294f297b1ed12f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.480208:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f535b6d4/0x1b294f297b1ed12f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.480236:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f535b6d4/0x1b294f297b1ed12f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.480246:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f535b6d4/0x1b294f297b1ed12f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.480279:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813185.480297:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813185.480299:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813185.480350:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813185.480368:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1eceea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d39 expref: 14 pid: 6676 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.480385:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1eceea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d39 expref: 14 pid: 6676 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.480407:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1eceea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d39 expref: 14 pid: 6676 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.480422:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788813185.480428:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788813185.480435:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed128 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.480447:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed128 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.480492:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813185.480579:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3658b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+13:2364:x1875706308032128:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 539us (2112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813185.480588:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 84 00010000:00010000:0.0:1788813185.482188:0:8122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed128 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.482214:0:8122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed128 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.482228:0:8122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed128 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.482238:0:8122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed128 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.482271:0:8122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788813185.483400:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3302:x1875706322692608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17249us (21763us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788813185.483415:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:0.0:1788813185.483501:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ee07d1e680/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788813185.483510:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee07d1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322692608:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788813185.484423:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813185.484434:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed128 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.484449:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619a00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813185.484455:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed128 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.484467:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed128 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.484494:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed128 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.484503:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed128 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.484530:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813185.484532:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813185.484534:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813185.520897:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+12:2363:x1875706308032000:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 50102us (54993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813185.520916:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 68 00000001:00080000:2.0:1788813185.520966:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:2.0:1788813185.520979:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:2.0:1788813185.520984:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:2.0:1788813185.525598:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813185.525702:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308032384 00000100:00100000:3.0:1788813185.525716:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308032384 00000100:00100000:3.0:1788813185.525843:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 227 00000100:00100000:3.0:1788813185.525857:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3658ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+20:11614:x1875706308032384:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788813185.525952:0:8565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813185.525988:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ed113 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dcc expref: 20 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.526012:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93ef19f1fc00) 00010000:00010000:3.0:1788813185.526018:0:8565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813185.526276:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed136 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.526294:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed136 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.526307:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed136 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813185.526637:0:8565:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da93617e reply state 00000000df0e1ca0 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed136 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813185.526649:0:8565:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788813185.527110:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3658ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+21:11614:x1875706308032384:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 1253us (1523us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788813185.527120:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 227 00000100:00100000:0.0:1788813185.530355:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813185.531323:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308032512 00000100:00100000:2.0:1788813185.531339:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308032512 00000100:00100000:2.0:1788813185.531428:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:2.0:1788813185.531440:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+7:2365:x1875706308032512:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788813185.531717:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788813185.531722:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788813185 -> 1788813184 00002000:00010000:2.0:1788813185.531725:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788813184 00002000:00010000:2.0:1788813185.531728:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788813185 -> 1788813184 00002000:00010000:2.0:1788813185.531731:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788813185.532006:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+8:2365:x1875706308032512:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 565us (1661us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788813185.532034:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:2.0:1788813185.534392:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813185.534596:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308032768 00000100:00100000:3.0:1788813185.534609:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308032768 00000100:00100000:3.0:1788813185.534687:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 228 00000100:00100000:3.0:1788813185.534699:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+21:11614:x1875706308032768:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788813185.534961:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517400/0x1b294f297b1ed13d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.535008:0:7630:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ed0f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dbe expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.535019:0:7630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517400/0x1b294f297b1ed13d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.535141:0:7630:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ed0f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dbe expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.535159:0:7630:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ed0f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dbe expref: 21 pid: 5834 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813185.535176:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3c6ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7630:1875706322693120:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788813185.535298:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1caf39c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788813185.538416:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed136 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.538438:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed136 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.538448:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed136 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.538455:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef01517200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813185.538460:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed136 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.538469:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed136 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.538490:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93ef19f1fc00) 00010000:00010000:1.0:1788813185.538494:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813185.538523:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed136 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.538530:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517200/0x1b294f297b1ed136 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813185.538950:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813185.539331:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308032896 00000100:00100000:0.0:1788813185.539343:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308032896 00010000:00010000:0.0:1788813185.539401:0:8439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ed0f7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dbe expref: 21 pid: 5834 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813185.539477:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:0.0:1788813185.539489:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3658a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+21:2366:x1875706308032896:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813185.539519:0:8439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813185.539527:0:8439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ed0f7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dbe expref: 21 pid: 5834 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.539541:0:8439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ed0f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dbe expref: 21 pid: 5834 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.539564:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93ef19f1fc00) 00010000:00010000:0.0:1788813185.539569:0:8439:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517400/0x1b294f297b1ed13d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.539581:0:8439:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517400/0x1b294f297b1ed13d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.539591:0:8439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517400/0x1b294f297b1ed13d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.539628:0:8439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813185.539702:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3658a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c560788-da9a-41fd-952d-091d96dace11+21:2366:x1875706308032896:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 215us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813185.539711:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 85 00010000:00010000:3.0:1788813185.539826:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc400/0x1b294f297b1ed0f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dbe expref: 20 pid: 5834 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813185.539845:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3c6ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7630:1875706322693120:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788813185.539872:0:7630:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517400/0x1b294f297b1ed13d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.539884:0:7630:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517400/0x1b294f297b1ed13d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.539889:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517400/0x1b294f297b1ed13d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.539925:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517400/0x1b294f297b1ed13d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.539941:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517400/0x1b294f297b1ed13d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.539948:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517400/0x1b294f297b1ed13d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.539955:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef01517400 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813185.539959:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517400/0x1b294f297b1ed13d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.539967:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517400/0x1b294f297b1ed13d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.539977:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93ef19f1fc00) 00010000:00010000:3.0:1788813185.539980:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788813185.539984:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517400/0x1b294f297b1ed13d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.539990:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517400/0x1b294f297b1ed13d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813185.540039:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+19:11614:x1875706308032768:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 Request processed in 5342us (5662us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788813185.540048:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 228 00000100:00100000:3.0:1788813185.542757:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813185.542949:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308033024 00000100:00100000:2.0:1788813185.542961:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308033024 00000100:00100000:2.0:1788813185.543039:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:2.0:1788813185.543051:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3c6ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+8:2364:x1875706308033024:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788813185.543124:0:8122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ed144 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.543153:0:8122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f70e8a67/0x1b294f297b1ed121 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dda expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.543163:0:8122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813185.543168:0:8122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813185.543173:0:8122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ed144 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.543219:0:8122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f70e8a67/0x1b294f297b1ed121 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dda expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.543236:0:8122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f70e8a67/0x1b294f297b1ed121 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dda expref: 8 pid: 6676 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813185.543253:0:8122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36589f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8122:1875706322693248:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788813185.543383:0:8122:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef212386c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813185.546902:0:8122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36589f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8122:1875706322693248:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788813185.546949:0:8122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ed144 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813185.547685:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813185.547912:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308033152 00000100:00100000:0.0:1788813185.547922:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308033152 00010000:00010000:0.0:1788813185.547974:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f70e8a67/0x1b294f297b1ed121 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dda expref: 9 pid: 6676 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813185.548018:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:0.0:1788813185.548030:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+9:2366:x1875706308033152:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813185.548071:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813185.548105:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f70e8a67/0x1b294f297b1ed121 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dda expref: 9 pid: 6676 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.548120:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f70e8a67/0x1b294f297b1ed121 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dda expref: 9 pid: 6676 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.548150:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f70e8a67/0x1b294f297b1ed121 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dda expref: 9 pid: 6676 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.548171:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813185.548176:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813185.548182:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ed144 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.548194:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ed144 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.548236:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813185.548307:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+8:2366:x1875706308033152:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 279us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813185.548315:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 86 00010000:00010000:2.0:1788813185.548459:0:8122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ed144 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.548470:0:8122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ed144 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.548501:0:8122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ed144 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.548511:0:8122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ed144 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.548520:0:8122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ed144 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.548528:0:8122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619e00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:2.0:1788813185.548533:0:8122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ed144 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.548544:0:8122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ed144 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.548558:0:8122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ed144 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.548566:0:8122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000124a2e35/0x1b294f297b1ed144 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813185.548632:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3c6ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+7:2364:x1875706308033024:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 5584us (5890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813185.548642:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:3.0:1788813185.551748:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813185.552414:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308033408 00000100:00100000:2.0:1788813185.552430:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308033408 00000100:00100000:2.0:1788813185.552549:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 229 00000100:00100000:2.0:1788813185.552562:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+19:11614:x1875706308033408:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788813185.552680:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ed14b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.552702:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ed14b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.552718:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ed14b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.553254:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed152 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.553269:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed105 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dc5 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.553279:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed152 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.553325:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed105 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dc5 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813185.553376:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed105 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dc5 expref: 20 pid: 5835 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813185.553394:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3658bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875706322693376:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788813185.553542:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef21238cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813185.557004:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3658bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875706322693376:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788813185.557045:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed152 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813185.558460:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813185.558590:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308033536 00000100:00100000:1.0:1788813185.558601:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308033536 00010000:00010000:1.0:1788813185.558651:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed105 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dc5 expref: 21 pid: 5835 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813185.558700:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00100000:1.0:1788813185.558712:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+21:2365:x1875706308033536:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813185.558731:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813185.558739:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed105 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dc5 expref: 21 pid: 5835 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.558751:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed105 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dc5 expref: 21 pid: 5835 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.558837:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517800/0x1b294f297b1ed105 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dc5 expref: 21 pid: 5835 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.558858:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93ef19f1fc00) 00010000:00010000:1.0:1788813185.558878:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed152 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.558889:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed152 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.558897:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed152 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813185.558935:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813185.558997:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+20:2365:x1875706308033536:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 286us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813185.559006:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 87 00010000:00010000:3.0:1788813185.559681:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed152 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.559696:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed152 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788813185.559985:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1788813185.560242:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1788813185.560301:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1788813185.560425:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5836:1875706322693504:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788813185.560504:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813185.560553:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef011c8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788813185.560917:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322693504 00000100:00100000:2.0:1788813185.560927:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322693504 00000100:00100000:2.0:1788813185.560996:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788813185.561008:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1875706322693504:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788813185.561124:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1875706322693504:12345-0@lo:1000:mdt00_002.0 Request processed in 118us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813185.561132:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788813185.561557:0:5836:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1788813185.561565:0:5836:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1788813185.561589:0:5836:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ee07d1df80, transno 4294967321 00000100:00100000:3.0:1788813185.561645:0:5836:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff93ee07d1e680 x1875706322692608/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788813201 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813185.561661:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5836:1875706322693504:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788813185.563152:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1788813185.563281:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5836:1875706322693632:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788813185.563375:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813185.563432:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1caf39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813185.563854:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322693632 00000100:00100000:0.0:1788813185.563863:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322693632 00000100:00100000:0.0:1788813185.563931:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788813185.563943:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1875706322693632:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788813185.564239:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5836:x1875706322693632:12345-0@lo:1000:mdt00_002.0 Request processed in 298us (863us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788813185.564248:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788813185.564710:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5836:1875706322693632:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788813185.564774:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed152 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.564828:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed152 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.564838:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed152 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.564845:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619a00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813185.564851:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed152 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.564861:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed152 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.564880:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93ef19f1fc00) 00010000:00010000:3.0:1788813185.564884:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813185.564890:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed152 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.564896:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed152 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.564937:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ed095 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.564944:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ed095 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.564950:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ed095 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.564955:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190ce800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813185.564964:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ed095 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.564972:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ed095 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.564982:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:3.0:1788813185.564984:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813185.564993:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ed09c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2da9 expref: 23 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.565006:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ed09c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2da9 expref: 23 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.565017:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ed09c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2da9 expref: 23 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.565273:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ed09c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2da9 expref: 23 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813185.565292:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875706322693760:192.168.203.13@tcp:105: 00000100:00100000:3.0:1788813185.565409:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1caf39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813185.570264:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1875706322693760:192.168.203.13@tcp:105: 00010000:00010000:0.0:1788813185.570306:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ed095 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.570318:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce800/0x1b294f297b1ed095 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.570372:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce000/0x1b294f297b1ed159 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.570389:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce000/0x1b294f297b1ed159 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.570402:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce000/0x1b294f297b1ed159 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.570414:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce000/0x1b294f297b1ed159 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.570419:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce000/0x1b294f297b1ed159 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.570425:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce000/0x1b294f297b1ed159 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.570430:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190ce000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813185.570434:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce000/0x1b294f297b1ed159 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.570461:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce000/0x1b294f297b1ed159 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.570473:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:0.0:1788813185.570476:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813185.570481:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce000/0x1b294f297b1ed159 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.570486:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce000/0x1b294f297b1ed159 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.570495:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ed14b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.570499:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ed14b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.570505:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ed14b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.570509:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813185.570512:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ed14b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.570517:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ed14b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.570524:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:0.0:1788813185.570526:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788813185.570529:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ed14b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.570543:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618800/0x1b294f297b1ed14b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813185.570883:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+23:11614:x1875706308033408:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 18320us (19145us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1788813185.570895:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 229 00000020:00080000:0.0:1788813185.570902:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788813185.571697:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788813185.571707:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788813185.572516:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788813185.572530:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788813185.574631:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813185.574690:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813185.574835:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308033664 00000100:00100000:0.0:1788813185.574847:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308033664 00000100:00100000:0.0:1788813185.574903:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308033920 00000100:00100000:0.0:1788813185.574906:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308033920 00000100:00100000:0.0:1788813185.574926:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:0.0:1788813185.574938:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+24:11613:x1875706308033664:12345-192.168.203.13@tcp:49:lfs.0 00000100:00100000:0.0:1788813185.575113:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+24:11613:x1875706308033664:12345-192.168.203.13@tcp:49:lfs.0 Request processed in 176us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813185.575121:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:0.0:1788813185.575139:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:0.0:1788813185.575146:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef0e7f8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+23:11614:x1875706308033920:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788813185.575967:0:5838:0:(mdd_object.c:4199:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788813185.576090:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1788813185.576149:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ed160 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.576169:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ed160 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.576183:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ed160 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.576207:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ed160 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.576215:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ed160 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.576223:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ed160 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.576252:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788813185.576335:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef0e7f8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+25:11614:x1875706308033920:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 1186us (1641us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788813185.576344:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 62 00000020:00080000:0.0:1788813185.576350:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788813185.576430:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813185.576438:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ed160 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.576446:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cfa00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813185.576451:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ed160 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.576461:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ed160 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.576478:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93ef1a079b00) 00010000:00010000:0.0:1788813185.576482:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788813185.576489:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ed160 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.576507:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cfa00/0x1b294f297b1ed160 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.576530:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813185.576532:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813185.576534:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813185.579896:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813185.580067:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308034176 00000100:00100000:3.0:1788813185.580080:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308034176 00000100:00100000:3.0:1788813185.580156:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 230 00000100:00100000:3.0:1788813185.580168:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+25:11613:x1875706308034176:12345-192.168.203.13@tcp:58:lfs.0 00000040:00080000:3.0:1788813185.580532:0:8565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788813185.580765:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+25:11613:x1875706308034176:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 597us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813185.580774:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 230 00000100:00100000:3.0:1788813185.606069:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813185.609260:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308034304 00000100:00100000:1.0:1788813185.609283:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308034304 00000100:00100000:3.0:1788813185.610003:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 231 00000100:00100000:3.0:1788813185.610019:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+25:11616:x1875706308034304:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813185.610049:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813185.610079:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517400/0x1b294f297b1ed167 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2de1 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.610168:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516800/0x1b294f297b1ed16e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.610188:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516800/0x1b294f297b1ed16e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.610204:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516800/0x1b294f297b1ed16e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.610226:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517600/0x1b294f297b1ed175 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.610235:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517600/0x1b294f297b1ed175 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.610243:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517600/0x1b294f297b1ed175 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.610568:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516000/0x1b294f297b1ed17c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.610591:0:7630:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ed087 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2da2 expref: 26 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.610602:0:7630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516000/0x1b294f297b1ed17c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.610663:0:7630:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ed087 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2da2 expref: 26 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.610682:0:7630:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ed087 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2da2 expref: 26 pid: 7630 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813185.610699:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7630:1875706322693888:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788813185.610997:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1caf3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813185.615219:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813185.615381:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308034560 00000100:00100000:2.0:1788813185.615393:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308034560 00000100:00100000:2.0:1788813185.615535:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:2.0:1788813185.615548:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+27:5597:x1875706308034560:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788813185.615934:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+28:5597:x1875706308034560:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 388us (728us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788813185.615943:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:3.0:1788813185.616573:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7630:1875706322693888:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788813185.616618:0:7630:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516000/0x1b294f297b1ed17c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813185.618375:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813185.618971:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308034688 00000100:00100000:0.0:1788813185.618987:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308034688 00010000:00010000:0.0:1788813185.619043:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ed087 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2da2 expref: 28 pid: 7630 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813185.619093:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:0.0:1788813185.619104:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef121e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+28:2365:x1875706308034688:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813185.619123:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813185.619131:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ed087 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2da2 expref: 28 pid: 7630 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.619147:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ed087 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2da2 expref: 28 pid: 7630 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.619178:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cea00/0x1b294f297b1ed087 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2da2 expref: 28 pid: 7630 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.619199:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:0.0:1788813185.619205:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516000/0x1b294f297b1ed17c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.619239:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516000/0x1b294f297b1ed17c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.619247:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516000/0x1b294f297b1ed17c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813185.619282:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813185.619354:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef121e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c560788-da9a-41fd-952d-091d96dace11+27:2365:x1875706308034688:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 252us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813185.619373:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 88 00010000:00010000:3.0:1788813185.620493:0:7630:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516000/0x1b294f297b1ed17c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.620510:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516000/0x1b294f297b1ed17c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813185.620572:0:7630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788813185.620578:0:7630:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813185.620617:0:7630:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516000/0x1b294f297b1ed17c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.620649:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516000/0x1b294f297b1ed17c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.620661:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516800/0x1b294f297b1ed16e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.620669:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516800/0x1b294f297b1ed16e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.620677:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516800/0x1b294f297b1ed16e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.620683:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef01516800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813185.620689:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516800/0x1b294f297b1ed16e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.620699:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516800/0x1b294f297b1ed16e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.620714:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:3.0:1788813185.620718:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813185.620724:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516800/0x1b294f297b1ed16e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.620731:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516800/0x1b294f297b1ed16e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.620749:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517600/0x1b294f297b1ed175 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.620756:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517600/0x1b294f297b1ed175 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.620778:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517600/0x1b294f297b1ed175 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.620827:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef01517600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813185.620831:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517600/0x1b294f297b1ed175 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.620839:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517600/0x1b294f297b1ed175 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.620849:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93ef077b4b00) 00010000:00010000:3.0:1788813185.620851:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813185.620855:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517600/0x1b294f297b1ed175 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.620860:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517600/0x1b294f297b1ed175 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.620913:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517400/0x1b294f297b1ed167 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2de1 expref: 27 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.620931:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516000/0x1b294f297b1ed17c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2de1 expref: 26 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813185.620939:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:3.0:1788813185.620941:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813185.620944:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef01516000, rc 0) 00000100:00100000:3.0:1788813185.621007:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+26:11616:x1875706308034304:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 10992us (14951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813185.621028:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 231 00010000:00010000:0.0:1788813186.013044:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788813186.592087:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788813186.592102:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788813186.592394:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788813186.592403:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788813186.592600:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee07d1df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1875706322694016:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788813186.592737:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee066bbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788813186.611069:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee07d1df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1875706322694016:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788813186.611414:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813186.611609:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308034816 00000100:00100000:1.0:1788813186.611619:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308034816 00000100:00100000:1.0:1788813186.611715:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 232 00000100:00100000:1.0:1788813186.611728:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+26:11627:x1875706308034816:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788813186.611848:0:5836:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00080000:2.0:1788813186.612018:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813186.614584:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+26:11627:x1875706308034816:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 2845us (3159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813186.614604:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 232 00000100:00100000:0.0:1788813186.619447:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813186.619580:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308035072 00000100:00100000:3.0:1788813186.619595:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308035072 00000100:00100000:3.0:1788813186.619676:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 233 00000100:00100000:3.0:1788813186.619690:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+26:11627:x1875706308035072:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813186.619722:0:8565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813186.619752:0:8565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517400/0x1b294f297b1ed183 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2de8 expref: -99 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813186.620039:0:8565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517600/0x1b294f297b1ed18a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813186.620060:0:8565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517600/0x1b294f297b1ed18a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813186.620076:0:8565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517600/0x1b294f297b1ed18a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813186.620091:0:8565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788813186.620399:0:8565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517400/0x1b294f297b1ed183 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2de8 expref: 29 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813186.620419:0:8565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517600/0x1b294f297b1ed18a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2de8 expref: 28 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813186.620429:0:8565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:3.0:1788813186.620432:0:8565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813186.620447:0:8565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef01517600, rc 0) 00000100:00100000:3.0:1788813186.621278:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+28:11627:x1875706308035072:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1585us (1838us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788813186.621291:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 233 00000100:00100000:2.0:1788813186.635954:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813186.636003:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813186.636038:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308035200 00000100:00100000:2.0:1788813186.636050:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308035200 00000100:00100000:2.0:1788813186.636140:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:2.0:1788813186.636153:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3658bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+28:2365:x1875706308035200:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813186.636186:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813186.636219:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517600/0x1b294f297b1ed18a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2de8 expref: 28 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813186.636248:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:2.0:1788813186.636254:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813186.636322:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3658bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c560788-da9a-41fd-952d-091d96dace11+27:2365:x1875706308035200:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 172us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813186.636331:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:2.0:1788813186.636370:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308035456 00000100:00100000:2.0:1788813186.636374:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308035456 00000100:00100000:2.0:1788813186.636402:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 234 00000100:00100000:2.0:1788813186.636409:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+27:11627:x1875706308035456:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788813186.636495:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed198 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813186.636514:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed198 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813186.636527:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed198 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813186.636863:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed198 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813186.636872:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed198 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813186.636891:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed198 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813186.636898:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813186.636903:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed198 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813186.636913:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed198 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813186.636922:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:2.0:1788813186.636925:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788813186.636930:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed198 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813186.636937:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed198 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813186.637083:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+28:11627:x1875706308035456:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 673us (1079us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788813186.637093:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 234 00000040:00080000:2.0:1788813186.637387:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788813186.637393:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788813186.637939:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788813186.637949:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788813186.652294:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813186.661346:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308035712 00000100:00100000:1.0:1788813186.661378:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308035712 00000100:00100000:1.0:1788813186.661464:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:1.0:1788813186.661478:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3658aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+28:11627:x1875706308035712:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000040:00080000:0.0:1788813186.662109:0:12562:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813186.662115:0:12562:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813186.662182:0:12562:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788813186.662194:0:12562:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788813186.664118:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3658aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+29:11627:x1875706308035712:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 2627us (11818us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788813186.664137:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:0.0:1788813186.717129:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322694144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813186.717237:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813186.717330:0:10074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322694144 00000100:00100000:0.0:1788813186.717341:0:10074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322694144 00000100:00100000:0.0:1788813186.717420:0:10074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788813186.717431:0:10074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef19623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875706322694144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813186.717474:0:10074:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813186.717528:0:10074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef19623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875706322694144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813186.717536:0:10074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1788813186.717814:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813186.717880:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322694144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813186.718185:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322694272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813186.718225:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813186.719033:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322694528:0@lo:400:kworker.0 00000100:00100000:0.0:1788813186.719084:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813186.719114:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813186.719120:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322694656:0@lo:400:kworker.0 00000100:00100000:0.0:1788813186.719142:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813186.719169:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322694400:0@lo:400:kworker.0 00000100:00100000:0.0:1788813186.719202:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813186.719233:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788813186.719238:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1875706322694784:0@lo:400:kworker.0 00000100:00100000:0.0:1788813186.719261:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813186.719289:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322694528 00000100:00100000:0.0:1788813186.719296:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322694528 00000100:00100000:0.0:1788813186.719360:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322694656 00000100:00100000:0.0:1788813186.719363:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322694656 00000100:00100000:0.0:1788813186.719391:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322694784 00000100:00100000:0.0:1788813186.719393:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322694784 00000100:00100000:0.0:1788813186.719410:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788813186.719420:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322694528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813186.719467:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322694528:12345-0@lo:400:kworker.0 Request processed in 48us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813186.719475:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788813186.719491:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788813186.719498:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322694656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813186.719556:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322694656:12345-0@lo:400:kworker.0 Request processed in 59us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813186.719563:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788813186.719576:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788813186.719582:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875706322694784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813186.719611:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875706322694784:12345-0@lo:400:kworker.0 Request processed in 29us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813186.719617:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:0.0:1788813186.719634:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813186.719672:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1875706322694784:0@lo:400:kworker.0 00000100:00100000:0.0:1788813186.719701:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322694656:0@lo:400:kworker.0 00000100:00100000:0.0:1788813186.719710:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322694528:0@lo:400:kworker.0 00000100:00100000:0.0:1788813186.719770:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322694400 00000100:00100000:0.0:1788813186.719775:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322694400 00000100:00100000:0.0:1788813186.719834:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788813186.719842:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3302:x1875706322694400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813186.719877:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3302:x1875706322694400:12345-0@lo:400:kworker.0 Request processed in 37us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813186.719883:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788813186.719915:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322694400:0@lo:400:kworker.0 00000100:00100000:3.0:1788813186.721029:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322694272 00000100:00100000:3.0:1788813186.721041:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322694272 00000100:00100000:3.0:1788813186.721095:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788813186.721104:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1875706322694272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813186.721144:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813186.721218:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1875706322694272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (2992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813186.721225:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788813186.721280:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322694272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813186.853868:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813186.853953:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308035968 00000100:00100000:3.0:1788813186.853967:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308035968 00000100:00100000:3.0:1788813186.854047:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 235 00000100:00100000:3.0:1788813186.854060:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3658b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+29:11640:x1875706308035968:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813186.854092:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813186.854121:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517400/0x1b294f297b1ed19f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2def expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813186.854258:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516800/0x1b294f297b1ed1a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813186.854278:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516800/0x1b294f297b1ed1a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813186.854294:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516800/0x1b294f297b1ed1a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813186.854326:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788813186.854492:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01517400/0x1b294f297b1ed19f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2def expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813186.854515:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516800/0x1b294f297b1ed1a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2def expref: 31 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813186.854526:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:3.0:1788813186.854529:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788813186.854544:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef01516800, rc 0) 00000100:00100000:3.0:1788813186.854621:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3658b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c560788-da9a-41fd-952d-091d96dace11+31:11640:x1875706308035968:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 564us (764us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788813186.854630:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 235 00000100:00100000:3.0:1788813186.858133:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813186.858395:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308036096 00000100:00100000:2.0:1788813186.858407:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308036096 00000100:00100000:2.0:1788813186.858558:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 236 00000100:00100000:2.0:1788813186.858571:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+31:11640:x1875706308036096:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:2.0:1788813186.858655:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ed1b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813186.858677:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ed1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813186.858692:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ed1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813186.858725:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ed1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813186.858733:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ed1b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813186.858741:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ed1b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813186.858749:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619e00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813186.858754:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ed1b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813186.858777:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ed1b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813186.858818:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:2.0:1788813186.858822:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813186.858828:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ed1b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813186.858846:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619e00/0x1b294f297b1ed1b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813186.858941:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c560788-da9a-41fd-952d-091d96dace11+31:11640:x1875706308036096:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 373us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813186.858950:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 236 00000100:00100000:2.0:1788813186.959296:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813186.959759:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308036224 00000100:00100000:0.0:1788813186.959772:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308036224 00000100:00100000:0.0:1788813186.961373:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:0.0:1788813186.961411:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3658a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+7:2366:x1875706308036224:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:0.0:1788813186.961460:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813186.962195:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005090aa74/0x1b294f297b1ed1bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2df6 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788813186.962239:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9f1f80, atime: 0x6a9f1f80, ctime: 0x6a9f1f80, blocks: 0xb 00010000:00010000:0.0:1788813186.962270:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1788813186.962275:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813186.962288:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005090aa74/0x1b294f297b1ed1bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2df6 expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813186.962311:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005090aa74/0x1b294f297b1ed1bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2df6 expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813186.962328:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cf200, rc 0) 00000100:00100000:0.0:1788813186.963144:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3658a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+8:2366:x1875706308036224:12345-192.168.203.13@tcp:101:cat.0 Request processed in 1749us (3857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813186.963156:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:0.0:1788813186.970731:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813186.978199:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308036352 00000100:00100000:2.0:1788813186.978219:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308036352 00002000:00100000:2.0:1788813186.978297:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff93ef36b07b80 x1875706308036352/t0(0) o3->9c560788-da9a-41fd-952d-091d96dace11@192.168.203.13@tcp:2/0 lens 488/0 e 0 to 0 dl 1788813197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788813186.978310:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93ef36b07b80 with x1875706308036352 ext(0->4095) 00002000:00010000:2.0:1788813186.978318:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ef36b07b80 00000100:00100000:2.0:1788813186.978451:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1788813186.978462:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9c560788-da9a-41fd-952d-091d96dace11+8:2365:x1875706308036352:12345-192.168.203.13@tcp:3:cat.0 00000100:00100000:2.0:1788813186.978747:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9c560788-da9a-41fd-952d-091d96dace11+8:2365:x1875706308036352:12345-192.168.203.13@tcp:3:cat.0 Request processed in 286us (8030us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788813186.978756:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00002000:00100000:2.0:1788813186.978764:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff93ef36b07b80 x1875706308036352/t0(0) o3->9c560788-da9a-41fd-952d-091d96dace11@192.168.203.13@tcp:2/0 lens 488/4536 e 0 to 0 dl 1788813197 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788813186.978773:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93ef36b07b80 with x1875706308036352 ext(0->4095) 00002000:00010000:2.0:1788813186.978777:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93ef36b07b80 00010000:00010000:0.0:1788813187.040216:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813188.062065:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813189.066973:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813189.067023:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813189.067055:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813189.067117:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308036608 00000100:00100000:0.0:1788813189.067132:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308036608 00000100:00100000:2.0:1788813189.067197:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308036480 00000100:00100000:2.0:1788813189.067201:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308036480 00000100:00100000:2.0:1788813189.067269:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 296 00000100:00100000:2.0:1788813189.067297:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2134fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+13:2363:x1875706308036480:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813189.067371:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813189.067402:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308036992 00000100:00100000:3.0:1788813189.067406:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308036992 00000100:00100000:0.0:1788813189.067479:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 155 00000100:00100000:2.0:1788813189.067508:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2134fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2aa2133f-e434-4510-82b0-9799a685adfa+13:2363:x1875706308036480:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 124us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813189.067517:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 296 00000100:00080000:2.0:1788813189.067673:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813189.070592:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308036736 00000100:00100000:1.0:1788813189.070613:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308036736 00000100:00100000:1.0:1788813189.070725:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:1.0:1788813189.070737:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+5:2363:x1875706308036736:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813189.071260:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+5:2363:x1875706308036736:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 524us (4202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813189.071269:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:0.0:1788813189.072205:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+31:2364:x1875706308036608:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813189.072223:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813189.072271:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c560788-da9a-41fd-952d-091d96dace11+31:2364:x1875706308036608:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 4784us (5246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813189.072305:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 155 00000100:00100000:3.0:1788813189.072523:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308036864 00000100:00100000:3.0:1788813189.072534:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308036864 00000100:00100000:3.0:1788813189.072585:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:3.0:1788813189.072655:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+8:2364:x1875706308036864:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813189.072695:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c560788-da9a-41fd-952d-091d96dace11+8:2364:x1875706308036864:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 44us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813189.072710:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:3.0:1788813189.072896:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 156 00000100:00100000:3.0:1788813189.072906:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2363:x1875706308036992:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813189.072981:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2363:x1875706308036992:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 78us (5611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813189.072989:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 156 00000100:00080000:2.0:1788813189.075663:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813189.075674:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788813189.085085:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813190.117221:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788813190.367349:0:6700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1788813190.883460:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967514 is committed 00000001:00080000:1.0:1788813190.883482:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:1.0:1788813190.883489:0:5856:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:1.0:1788813190.883514:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1788813190.883526:0:5856:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93ef20e1f840 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788813190.883531:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ee04942700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93ef20e1fe40 00000020:00080000:1.0:1788813190.883535:0:5856:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93ee04942800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93ef36f9e400 00000020:00080000:1.0:1788813190.883571:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1788813190.883779:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1788813190.900874:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1788813190.900906:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:0.0:1788813191.133974:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813191.833857:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813191.837044:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322694912:0@lo:400:kworker.0 00000100:00100000:0.0:1788813191.837109:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813191.837156:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1875706322695424:0@lo:400:kworker.0 00000100:00100000:0.0:1788813191.837182:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813191.837312:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1875706322695168:0@lo:400:kworker.0 00000100:00100000:1.0:1788813191.837362:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36b05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322695040:0@lo:400:kworker.0 00000100:00100000:1.0:1788813191.837401:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322694912 00000100:00100000:1.0:1788813191.837409:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322694912 00000100:00100000:1.0:1788813191.837470:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788813191.837479:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3302:x1875706322694912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813191.837527:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3302:x1875706322694912:12345-0@lo:400:kworker.0 Request processed in 49us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813191.837534:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788813191.837838:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322695296:0@lo:400:kworker.0 00000100:00100000:3.0:1788813191.837873:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813191.837932:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322695296 00000100:00100000:3.0:1788813191.837936:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322695296 00000100:00100000:3.0:1788813191.839610:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788813191.839624:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3600cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322695296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813191.839700:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3600cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322695296:12345-0@lo:400:kworker.0 Request processed in 81us (1825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813191.839708:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788813191.839874:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322695808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813191.839903:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813191.839957:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788813191.839962:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ef36588a80, transno 4294967310 00000100:00100000:3.0:1788813191.839975:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322695296:0@lo:400:kworker.0 00000100:00100000:3.0:1788813191.840009:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322695808 00000100:00100000:3.0:1788813191.840027:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322695808 00000100:00100000:3.0:1788813191.840057:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788813191.840063:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322695808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813191.840092:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813191.840128:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322695808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813191.840134:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788813191.840459:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1788813191.840464:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ee07d1e680, transno 4294967322 00000004:00080000:3.0:1788813191.840475:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1788813191.840495:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322695808:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788813191.840815:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788813191.840820:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813191.841067:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322694912:0@lo:400:kworker.0 00000100:00100000:1.0:1788813191.841146:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308037120 00000100:00100000:1.0:1788813191.841152:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308037120 00000100:00100000:3.0:1788813191.841201:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813191.841202:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322695424 00000100:00100000:1.0:1788813191.841207:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322695424 00000100:00100000:1.0:1788813191.841229:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322695040 00000100:00100000:1.0:1788813191.841232:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322695040 00000100:00100000:3.0:1788813191.841236:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322695552:0@lo:400:kworker.0 00000100:00100000:1.0:1788813191.841250:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788813191.841259:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875706322695424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813191.841273:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813191.841311:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875706322695424:12345-0@lo:400:kworker.0 Request processed in 53us (4127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813191.841327:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788813191.841337:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788813191.841342:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322695040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813191.841358:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 237 00000100:00100000:1.0:1788813191.841368:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+18:11302:x1875706308037120:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788813191.841384:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322695040:12345-0@lo:400:kworker.0 Request processed in 46us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813191.841392:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788813191.841418:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322695552 00000100:00100000:3.0:1788813191.841422:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322695552 00000100:00100000:3.0:1788813191.841447:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788813191.841453:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+18:11302:x1875706308037120:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 Request processed in 86us (7606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813191.841456:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322695552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813191.841468:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 237 00000100:00100000:3.0:1788813191.841496:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322695552:12345-0@lo:400:kworker.0 Request processed in 42us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813191.841502:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788813191.841541:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322695040:0@lo:400:kworker.0 00000100:00100000:1.0:1788813191.841599:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813191.841623:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee07d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322695680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813191.841647:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813191.841675:0:10074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322695680 00000100:00100000:1.0:1788813191.841679:0:10074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322695680 00000100:00100000:1.0:1788813191.841700:0:10074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788813191.841706:0:10074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322695680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788813191.841729:0:10074:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813191.841761:0:10074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322695680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813191.841767:0:10074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788813191.841813:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322695168 00000100:00100000:1.0:1788813191.841817:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322695168 00000100:00100000:1.0:1788813191.841839:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788813191.841845:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875706322695168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813191.841873:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875706322695168:12345-0@lo:400:kworker.0 Request processed in 29us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813191.841879:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788813191.841908:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1875706322695168:0@lo:400:kworker.0 00000100:00100000:1.0:1788813191.841923:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee07d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322695680:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788813191.842007:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813191.842027:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1875706322695424:0@lo:400:kworker.0 00000100:00100000:3.0:1788813191.842054:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322695552:0@lo:400:kworker.0 00000100:00100000:1.0:1788813191.849336:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813191.849900:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308037376 00000100:00100000:3.0:1788813191.849913:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308037376 00000100:00100000:3.0:1788813191.849980:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:3.0:1788813191.849991:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+18:11302:x1875706308037376:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788813191.850414:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+19:11302:x1875706308037376:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 424us (1104us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788813191.850422:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 65 00010000:00010000:3.0:1788813192.164821:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813193.182739:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788813193.828601:0:12765:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 16:33:12 (1788813192) 00000040:00080000:2.0:1788813193.832940:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788813193.832948:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788813193.832983:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788813193.832990:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788813194.188334:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813194.188388:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813194.188419:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813194.188441:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813194.188463:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813194.188489:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308038016 00000100:00100000:1.0:1788813194.188498:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308038016 00000100:00100000:1.0:1788813194.188567:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308037632 00000100:00100000:1.0:1788813194.188571:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308037632 00000100:00100000:1.0:1788813194.188597:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 160 00000100:00100000:1.0:1788813194.188617:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2364:x1875706308038016:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813194.188689:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2364:x1875706308038016:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 85us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813194.188696:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 160 00000100:00100000:1.0:1788813194.188726:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 161 00000100:00100000:1.0:1788813194.188733:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+19:2364:x1875706308037632:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813194.188767:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+19:2364:x1875706308037632:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 34us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813194.188774:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 161 00000100:00100000:1.0:1788813194.188840:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308037760 00000100:00100000:1.0:1788813194.188846:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308037760 00000100:00100000:1.0:1788813194.188873:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308037888 00000100:00100000:1.0:1788813194.188876:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308037888 00000100:00100000:1.0:1788813194.188902:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:1.0:1788813194.188909:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+5:2364:x1875706308037760:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813194.188938:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+5:2364:x1875706308037760:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 30us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813194.188955:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:1.0:1788813194.188969:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:1.0:1788813194.188976:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+7:2364:x1875706308037888:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813194.189003:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c560788-da9a-41fd-952d-091d96dace11+7:2364:x1875706308037888:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 28us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813194.189009:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00080000:1.0:1788813194.189024:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788813194.189028:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788813194.189030:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813194.189270:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308037504 00000100:00100000:0.0:1788813194.189275:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308037504 00000100:00100000:0.0:1788813194.189328:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 298 00000100:00100000:0.0:1788813194.189337:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+13:2364:x1875706308037504:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813194.189379:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+13:2364:x1875706308037504:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 44us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813194.189385:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 298 00010000:00010000:3.0:1788813194.204978:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813195.229139:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788813195.994243:0:5856:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:1.0:1788813195.994264:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1788813195.994277:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788813195.994298:0:5867:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:1.0:1788813196.198010:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813196.198214:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308038144 00000100:00100000:2.0:1788813196.198225:0:7630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308038144 00000100:00100000:2.0:1788813196.198319:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 238 00000100:00100000:2.0:1788813196.198331:0:7630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:12306:x1875706308038144:12345-192.168.203.13@tcp:101:lsof.0 00010000:00010000:2.0:1788813196.198350:0:7630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813196.198371:0:7630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ed1c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2dfd expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.198438:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ed1c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.198452:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ed1c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.198466:0:7630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ed1c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813196.198515:0:7630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788813196.198518:0:7630:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788813196.198555:0:7630:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ed1c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.198577:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ed1c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dfd expref: 7 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.198594:0:7630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ed1c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dfd expref: 6 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813196.198602:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef10b7a600) 00010000:00010000:2.0:1788813196.198605:0:7630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813196.198609:0:7630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21618a00, rc 0) 00000100:00100000:2.0:1788813196.198670:0:7630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+6:12306:x1875706308038144:12345-192.168.203.13@tcp:101:lsof.0 Request processed in 342us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813196.198676:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 238 00000100:00080000:1.0:1788813196.198812:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788813196.254879:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813196.957055:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322695936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813196.957133:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813196.957619:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322696320:0@lo:400:kworker.0 00000100:00100000:1.0:1788813196.957668:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813196.957694:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813196.957699:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322696448:0@lo:400:kworker.0 00000100:00100000:1.0:1788813196.957732:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813196.957764:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875706322696192:0@lo:400:kworker.0 00000100:00100000:1.0:1788813196.957812:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813196.957832:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788813196.957837:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322696064:0@lo:400:kworker.0 00000100:00100000:1.0:1788813196.957866:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813196.957902:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1875706322696576:0@lo:400:kworker.0 00000100:00100000:1.0:1788813196.957925:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813196.957952:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322696320 00000100:00100000:1.0:1788813196.957960:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322696320 00000100:00100000:1.0:1788813196.958011:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322696192 00000100:00100000:1.0:1788813196.958015:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322696192 00000100:00100000:1.0:1788813196.958031:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322696576 00000100:00100000:1.0:1788813196.958034:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322696576 00000100:00100000:1.0:1788813196.958051:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788813196.958059:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322696320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813196.958225:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788813196.958233:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875706322696192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813196.958301:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813196.958311:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322696704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813196.958404:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322695936 00000100:00100000:2.0:1788813196.958408:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322695936 00000100:00100000:2.0:1788813196.958438:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788813196.958444:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322695936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813196.958471:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813196.964222:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813196.964433:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875706322696192:12345-0@lo:400:kworker.0 Request processed in 6190us (6608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813196.964446:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788813196.964481:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788813196.964495:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875706322696576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813196.964546:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875706322696576:12345-0@lo:400:kworker.0 Request processed in 58us (6621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813196.964552:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788813196.964606:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322696064 00000100:00100000:3.0:1788813196.964627:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322696064 00000100:00100000:0.0:1788813196.964720:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1875706322696576:0@lo:400:kworker.0 00000100:00100000:1.0:1788813196.965955:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322696320:12345-0@lo:400:kworker.0 Request processed in 7890us (8280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813196.965968:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788813196.966002:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322696704 00000100:00100000:1.0:1788813196.966009:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322696704 00000100:00100000:1.0:1788813196.966043:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788813196.966051:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322696704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788813196.966095:0:6678:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813196.966152:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322696704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (1940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813196.966159:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788813196.966202:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322696320:0@lo:400:kworker.0 00000100:00100000:2.0:1788813196.966440:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322695936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7994us (9304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813196.966449:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788813196.969876:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788813196.969899:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21325850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3300:x1875706322696064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813196.969984:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21325850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3300:x1875706322696064:12345-0@lo:400:kworker.0 Request processed in 98us (12118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813196.969991:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788813196.970039:0:8122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322696448 00000100:00100000:3.0:1788813196.970047:0:8122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322696448 00000100:00100000:3.0:1788813196.970078:0:8122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788813196.970084:0:8122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322696448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813196.975934:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322696704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813196.976778:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875706322696192:0@lo:400:kworker.0 00000100:00100000:0.0:1788813196.976823:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3300:1875706322696064:0@lo:400:kworker.0 00000100:00100000:2.0:1788813196.982567:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322695936:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788813196.982643:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788813196.982650:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813196.982653:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813196.982680:0:8122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322696448:12345-0@lo:400:kworker.0 Request processed in 12593us (24944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813196.982693:0:8122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788813196.982768:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322696448:0@lo:400:kworker.0 00010000:00010000:2.0:1788813197.277935:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813197.709053:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813197.709410:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308038400 00000100:00100000:2.0:1788813197.709425:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308038400 00000100:00100000:2.0:1788813197.709541:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:2.0:1788813197.709554:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+18:12308:x1875706308038400:12345-192.168.203.13@tcp:35:umount.0 00000100:00100000:2.0:1788813197.710133:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+19:12308:x1875706308038400:12345-192.168.203.13@tcp:35:umount.0 Request processed in 581us (1094us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788813197.710143:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00080000:1.0:1788813197.712355:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813197.714632:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813197.715035:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308038656 00000100:00100000:2.0:1788813197.715051:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308038656 00000100:00100000:2.0:1788813197.715127:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:2.0:1788813197.715138:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+19:12308:x1875706308038656:12345-192.168.203.13@tcp:35:umount.0 00000100:00100000:2.0:1788813197.717037:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+20:12308:x1875706308038656:12345-192.168.203.13@tcp:35:umount.0 Request processed in 1885us (2403us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788813197.717053:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:3.0:1788813197.722005:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813197.722176:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308038912 00000100:00100000:0.0:1788813197.722190:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308038912 00000100:00100000:0.0:1788813197.722273:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:0.0:1788813197.722296:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef0e7b7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+20:12308:x1875706308038912:12345-192.168.203.13@tcp:35:umount.0 00000100:00100000:0.0:1788813197.723228:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef0e7b7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c560788-da9a-41fd-952d-091d96dace11+21:12308:x1875706308038912:12345-192.168.203.13@tcp:35:umount.0 Request processed in 928us (1231us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788813197.723239:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:3.0:1788813197.725655:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813197.725946:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308039168 00000100:00100000:2.0:1788813197.725958:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308039168 00000100:00100000:2.0:1788813197.726071:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:2.0:1788813197.726085:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+21:12308:x1875706308039168:12345-192.168.203.13@tcp:35:umount.0 00000100:00100000:2.0:1788813197.726556:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9c560788-da9a-41fd-952d-091d96dace11+22:12308:x1875706308039168:12345-192.168.203.13@tcp:35:umount.0 Request processed in 474us (912us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788813197.726566:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:1.0:1788813197.733472:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813197.733556:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813197.733735:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813197.733863:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308039296 00000100:00100000:0.0:1788813197.733881:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308039808 00000100:00100000:2.0:1788813197.733884:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308039296 00000100:00100000:0.0:1788813197.733885:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308039808 00000100:00100000:2.0:1788813197.733941:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308039424 00000100:00100000:2.0:1788813197.733943:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308039424 00000100:00100000:0.0:1788813197.733945:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:0.0:1788813197.733956:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+7:2362:x1875706308039808:12345-192.168.203.13@tcp:9:umount.0 00000100:00100000:2.0:1788813197.733962:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:2.0:1788813197.733968:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2aa2133f-e434-4510-82b0-9799a685adfa+14:2363:x1875706308039296:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813197.733983:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:0.0:1788813197.733995:0:6675:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ec78f 00000020:00010000:0.0:1788813197.734004:0:6675:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93ef217b6800: total 0 00010000:00010000:2.0:1788813197.734005:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef4214c200/0x1b294f297b1ec24f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce298f expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788813197.734010:0:6675:0:(import.c:65:import_set_state_nolock()) ffff93ef217b5000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788813197.734025:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00000004:0.0:1788813197.734071:0:6675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788813197.734092:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2aa2133f-e434-4510-82b0-9799a685adfa+13:2363:x1875706308039296:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 123us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813197.734100:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:2.0:1788813197.734122:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:2.0:1788813197.734127:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2aa2133f-e434-4510-82b0-9799a685adfa+12:2363:x1875706308039424:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813197.734135:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813197.734143:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef4214d800/0x1b294f297b1ec1b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2957 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813197.734152:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813197.734170:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2aa2133f-e434-4510-82b0-9799a685adfa+11:2363:x1875706308039424:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 42us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813197.734175:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000020:00010000:2.0:1788813197.734249:0:5821:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93ef217b6800: total 0 00010000:00010000:2.0:1788813197.734305:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93ef217b6800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788813197.734361:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005090aa74/0x1b294f297b1ed1bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2df6 expref: 5 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813197.734377:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c560788-da9a-41fd-952d-091d96dace11+5:2362:x1875706308039808:12345-192.168.203.13@tcp:9:umount.0 Request processed in 423us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813197.734385:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 72 00010000:00010000:2.0:1788813197.734411:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061a3daae/0x1b294f297b1ecb2b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c2f expref: 3 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788813197.734411:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788813197.734425:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93ef217b6800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788813197.734438:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813197.734440:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813197.734442:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813197.734537:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813197.735038:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308039936 00000100:00100000:3.0:1788813197.735046:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308039936 00000100:00100000:3.0:1788813197.735100:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:3.0:1788813197.735108:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2aa2133f-e434-4510-82b0-9799a685adfa+11:2364:x1875706308039936:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813197.735120:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813197.735131:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef1164e200/0x1b294f297b1ec463 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a5a expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813197.735143:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813197.735173:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2aa2133f-e434-4510-82b0-9799a685adfa+10:2364:x1875706308039936:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 65us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813197.735192:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:3.0:1788813197.742473:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813197.742855:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308040064 00000100:00100000:1.0:1788813197.742868:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308040064 00000100:00100000:1.0:1788813197.742964:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:1.0:1788813197.742977:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+5:2362:x1875706308040064:12345-192.168.203.13@tcp:9:umount.0 00000020:00000080:1.0:1788813197.743018:0:6676:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ec527 00000100:00080000:1.0:1788813197.743039:0:6676:0:(import.c:65:import_set_state_nolock()) ffff93ef217b1800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788813197.743090:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1788813197.743114:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813197.743465:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c560788-da9a-41fd-952d-091d96dace11+2:2362:x1875706308040064:12345-192.168.203.13@tcp:9:umount.0 Request processed in 489us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813197.743475:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00080000:0.0:1788813197.744160:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813197.750705:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813197.751000:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308041088 00000100:00100000:3.0:1788813197.751013:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308041088 00000100:00100000:3.0:1788813197.751138:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 239 00000100:00100000:3.0:1788813197.751150:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3658aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+22:2362:x1875706308041088:12345-192.168.203.13@tcp:39:umount.0 00000020:00000080:3.0:1788813197.751195:0:5836:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ec1c3 00000020:00010000:3.0:1788813197.751214:0:5836:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93ef36d81800: total 0 00000100:00080000:3.0:1788813197.751225:0:5836:0:(import.c:65:import_set_state_nolock()) ffff93ef36d84000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788813197.751301:0:5836:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:2.0:1788813197.751480:0:5821:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93ef36d81800: total 0 00010000:00010000:2.0:1788813197.751486:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813197.751918:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3658aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c560788-da9a-41fd-952d-091d96dace11+21:2362:x1875706308041088:12345-192.168.203.13@tcp:39:umount.0 Request processed in 766us (1223us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788813197.751928:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 239 00010000:00010000:2.0:1788813197.751949:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93ef36d81800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788813197.751992:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:2.0:1788813197.752001:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813197.752011:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ecaec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c1a expref: 20 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813197.752033:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:2.0:1788813197.752035:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788813197.752040:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190ce600/0x1b294f297b1ed09c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2da9 expref: 19 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813197.752055:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:2.0:1788813197.752058:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788813197.752062:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc200/0x1b294f297b1ecb9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c4b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813197.752104:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ef077b4200) 00010000:00010000:2.0:1788813197.752107:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813197.752111:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ec4a9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a6f expref: 17 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813197.752130:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93ef1a079f00) 00010000:00010000:2.0:1788813197.752132:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813197.752136:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef00031c00/0x1b294f297b1ec48d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a68 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813197.752150:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:2.0:1788813197.752158:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788813197.752162:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ecb16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c28 expref: 15 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813197.752175:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef10b7a600) 00010000:00010000:2.0:1788813197.752177:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813197.752180:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618000/0x1b294f297b1ecb7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2c44 expref: 14 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813197.752192:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:2.0:1788813197.752194:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788813197.752197:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ec7ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2b56 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813197.752211:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93ef10b7aa00) 00010000:00010000:2.0:1788813197.752213:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788813197.752224:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf400/0x1b294f297b1eca0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2be2 expref: 12 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813197.752242:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:2.0:1788813197.752244:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813197.752251:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516000/0x1b294f297b1ed17c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2de1 expref: 11 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813197.752357:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93ef1a079a00) 00010000:00010000:2.0:1788813197.752360:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788813197.752365:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef421e8400/0x1b294f297b1ec4fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a84 expref: 10 pid: 8565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813197.752382:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93ef077b4c00) 00010000:00010000:2.0:1788813197.752384:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788813197.752388:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef01516800/0x1b294f297b1ed1a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2def expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813197.752403:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93ef19f1fb00) 00010000:00010000:2.0:1788813197.752406:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788813197.752410:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ece7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2d1d expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813197.753468:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93ef36d81800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788813197.753517:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813197.753520:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813197.753522:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813198.301098:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813199.308431:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813199.308509:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813199.308616:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308041344 00000100:00100000:3.0:1788813199.308630:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308041344 00000100:00100000:3.0:1788813199.308742:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 165 00000100:00100000:3.0:1788813199.308754:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+6:2366:x1875706308041344:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813199.308885:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+6:2366:x1875706308041344:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 134us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813199.308893:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 165 00000100:00080000:0.0:1788813199.309438:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813199.309719:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308041216 00000100:00100000:1.0:1788813199.309728:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308041216 00000100:00100000:1.0:1788813199.309872:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 300 00000100:00100000:1.0:1788813199.309882:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21327850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+10:2366:x1875706308041216:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813199.309952:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21327850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2aa2133f-e434-4510-82b0-9799a685adfa+10:2366:x1875706308041216:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 72us (1536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813199.309959:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 300 00010000:00010000:2.0:1788813199.326764:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813199.409585:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813199.409695:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813199.418356:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813199.422271:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308041472 00000100:00100000:0.0:1788813199.422293:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308041472 00000100:00100000:0.0:1788813199.422441:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308041728 00000100:00100000:0.0:1788813199.422445:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308041728 00000100:00100000:0.0:1788813199.422486:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:0.0:1788813199.422498:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3658b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2aa2133f-e434-4510-82b0-9799a685adfa+11:2364:x1875706308041472:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813199.422519:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813199.422544:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ec295 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce29a4 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813199.422569:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813199.422669:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3658b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2aa2133f-e434-4510-82b0-9799a685adfa+10:2364:x1875706308041472:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 173us (13097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813199.422677:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:0.0:1788813199.422700:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:0.0:1788813199.423537:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3658b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2aa2133f-e434-4510-82b0-9799a685adfa+9:2364:x1875706308041728:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813199.423558:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813199.423575:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef00030e00/0x1b294f297b1ec45c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2a53 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813199.423590:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813199.423695:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3658b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2aa2133f-e434-4510-82b0-9799a685adfa+8:2364:x1875706308041728:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 987us (13999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813199.423704:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:2.0:1788813199.425892:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813199.429173:0:8565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308041984 00000100:00100000:3.0:1788813199.429202:0:8565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308041984 00000100:00100000:3.0:1788813199.429311:0:8565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 240 00000100:00100000:3.0:1788813199.429325:0:8565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3658a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+6:2362:x1875706308041984:12345-192.168.203.13@tcp:39:umount.0 00000020:00000080:3.0:1788813199.429390:0:8565:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ec2aa 00000020:00010000:3.0:1788813199.429422:0:8565:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93ef217b4000: total 0 00000100:00080000:3.0:1788813199.429428:0:8565:0:(import.c:65:import_set_state_nolock()) ffff93ef217b5800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788813199.429471:0:8565:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1788813199.430885:0:8565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3658a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64+5:2362:x1875706308041984:12345-192.168.203.13@tcp:39:umount.0 Request processed in 1552us (4993us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788813199.430900:0:8565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 240 00000020:00010000:2.0:1788813199.434201:0:5822:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93ef217b4000: total 0 00010000:00010000:2.0:1788813199.434309:0:5822:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93ef217b4000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788813199.434355:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef10b7a600) 00010000:00010000:2.0:1788813199.434360:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813199.434375:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618a00/0x1b294f297b1ed1c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2dfd expref: 4 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813199.434404:0:5822:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93ef217b4000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788813199.434416:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813199.434419:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813199.434421:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813199.443150:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308041600 00000100:00100000:1.0:1788813199.443171:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308041600 00000100:00100000:1.0:1788813199.443307:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:1.0:1788813199.443320:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef121e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2aa2133f-e434-4510-82b0-9799a685adfa+8:2364:x1875706308041600:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813199.443340:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813199.443365:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef1164f200/0x1b294f297b1ec29c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce29ce expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813199.443409:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813199.443501:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef121e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2aa2133f-e434-4510-82b0-9799a685adfa+7:2364:x1875706308041600:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 183us (25160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813199.443509:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:1.0:1788813199.464205:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813199.464447:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308042240 00000100:00100000:0.0:1788813199.464461:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308042240 00000100:00100000:0.0:1788813199.464544:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 301 00000100:00100000:0.0:1788813199.464557:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21326050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+7:2362:x1875706308042240:12345-192.168.203.13@tcp:251:umount.0 00000020:00000080:0.0:1788813199.464618:0:5828:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ec1a0 00000020:00010000:0.0:1788813199.464646:0:5828:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93ef36d87000: total 0 00000100:00080000:0.0:1788813199.464652:0:5828:0:(import.c:65:import_set_state_nolock()) ffff93ef36d80000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788813199.464990:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21326050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2aa2133f-e434-4510-82b0-9799a685adfa+3:2362:x1875706308042240:12345-192.168.203.13@tcp:251:umount.0 Request processed in 435us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813199.464999:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 301 00000020:00010000:2.0:1788813199.465571:0:5821:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93ef36d87000: total 0 00010000:00010000:2.0:1788813199.465578:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813199.465637:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93ef36d87000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788813199.465679:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef21619400/0x1b294f297b1ec256 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2996 expref: 2 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813199.465696:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93ef36d87000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788813199.466145:0:5821:0:(genops.c:885:class_export_put()) final put ffff93ef36d87000/2aa2133f-e434-4510-82b0-9799a685adfa 00010000:00010000:2.0:1788813199.466206:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813199.466208:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813199.466210:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788813199.470938:0:1248:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef36d87000/2aa2133f-e434-4510-82b0-9799a685adfa for MGS 00000020:00000080:1.0:1788813199.478353:0:1248:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93ef36d80000 for MGS 00010000:00010000:3.0:1788813200.351042:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788813200.689236:0:6700:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9c560788-da9a-41fd-952d-091d96dace11 00000020:00000080:3.0:1788813200.689250:0:6700:0:(genops.c:885:class_export_put()) final put ffff93ef217b2800/9c560788-da9a-41fd-952d-091d96dace11 00000020:00000080:0.0:1788813200.689323:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef217b2800/9c560788-da9a-41fd-952d-091d96dace11 for lustre-OST0000 00000020:00000080:0.0:1788813200.689390:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93ef217b1800 for lustre-OST0000 00000001:00100000:3.0:1788813201.164902:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9c560788-da9a-41fd-952d-091d96dace11 00000020:00000080:3.0:1788813201.164915:0:7632:0:(genops.c:885:class_export_put()) final put ffff93ef217b6800/9c560788-da9a-41fd-952d-091d96dace11 00000020:00000080:3.0:1788813201.164951:0:1248:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef217b6800/9c560788-da9a-41fd-952d-091d96dace11 for lustre-OST0001 00000020:00000080:3.0:1788813201.165010:0:1248:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93ef217b5000 for lustre-OST0001 00000001:00080000:2.0:1788813201.195585:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00080000:2.0:1788813201.195609:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:2.0:1788813201.195634:0:5856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64 00000001:00080000:2.0:1788813201.195641:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1788813201.195645:0:5856:0:(genops.c:885:class_export_put()) final put ffff93ef217b4000/d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64 00000001:00100000:2.0:1788813201.195659:0:5856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9c560788-da9a-41fd-952d-091d96dace11 00000001:00080000:2.0:1788813201.195665:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1788813201.195667:0:5856:0:(genops.c:885:class_export_put()) final put ffff93ef36d81800/9c560788-da9a-41fd-952d-091d96dace11 00000020:00000080:3.0:1788813201.195744:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef217b4000/d2250b69-4e90-4f3d-9cb3-b8c8d3dc1b64 for lustre-MDT0000 00000020:00000080:3.0:1788813201.195839:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef36d81800/9c560788-da9a-41fd-952d-091d96dace11 for lustre-MDT0000 00000020:00000080:3.0:1788813201.195880:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93ef217b5800 for lustre-MDT0000 00000020:00000080:3.0:1788813201.195884:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93ef36d84000 for lustre-MDT0000 00010000:00010000:3.0:1788813201.373299:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788813201.390730:0:12964:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788813201.407315:0:12964:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788813201.407365:0:12964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec225 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec22c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813201.407380:0:12964:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec225 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec22c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813201.407388:0:12964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec225 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b294f297b1ec22c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813201.407395:0:12964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b294f297b1ec22c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813201.407523:0:12964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788813201.407530:0:12964:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788813201.407552:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788813201.407556:0:12964:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788813201.407561:0:12964:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788813201.407583:0:12964:0:(import.c:65:import_set_state_nolock()) ffff93ef3adf1000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788813201.407652:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875706322696832:0@lo:39:umount.0 00000100:00100000:1.0:1788813201.407718:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788813201.408049:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813201.408057:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b294f297b1ec22c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.408065:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef00031a00 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:2.0:1788813201.408396:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b294f297b1ec22c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.408482:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b294f297b1ec22c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813201.408492:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b294f297b1ec22c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813201.408498:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788813201.408501:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788813201.408505:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788813201.408538:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec225 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b294f297b1ec22c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.408545:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788813201.408597:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3658bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322696960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813201.408644:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788813201.408706:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec225 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b294f297b1ec22c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.408715:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef00031a00/0x1b294f297b1ec225 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b294f297b1ec22c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.408743:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813201.408745:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813201.408746:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813201.408823:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322696832 00000100:00100000:0.0:1788813201.408831:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322696832 00000100:00100000:0.0:1788813201.408888:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788813201.408905:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875706322696832:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788813201.408930:0:5836:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ebfaf 00000100:00080000:0.0:1788813201.408937:0:5836:0:(import.c:65:import_set_state_nolock()) ffff93ef11774000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788813201.409008:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3298:x1875706322696832:12345-0@lo:39:umount.0 Request processed in 104us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813201.409015:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:0.0:1788813201.409024:0:5836:0:(genops.c:885:class_export_put()) final put ffff93ef11770000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:0.0:1788813201.409051:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322696960 00000100:00100000:0.0:1788813201.409055:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322696960 00000100:00100000:0.0:1788813201.409088:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788813201.409095:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+19:3301:x1875706322696960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813201.409104:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813201.409119:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef21619800/0x1b294f297b1ec22c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b294f297b1ec225 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813201.409131:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813201.409212:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813201.409647:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:3301:x1875706322696960:12345-0@lo:103:ldlm_bl.0 Request processed in 549us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813201.409655:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000020:00000080:0.0:1788813201.409683:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef11770000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788813201.409743:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93ef11774000 for lustre-MDT0000 00000100:00080000:0.0:1788813201.409818:0:3298:0:(import.c:65:import_set_state_nolock()) ffff93ef3adf1000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788813201.409832:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875706322696832:0@lo:39:umount.0 00000100:00080000:0.0:1788813201.409858:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788813201.409874:0:12964:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788813201.409879:0:12964:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1788813201.410802:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3658bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322696960:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813201.411534:0:12964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec233 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec23a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813201.411561:0:12964:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec233 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec23a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813201.411569:0:12964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec233 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b294f297b1ec23a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813201.411576:0:12964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec233 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b294f297b1ec23a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813201.411637:0:12964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813201.411644:0:12964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214da00/0x1b294f297b1ec15a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec161 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813201.411652:0:12964:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214da00/0x1b294f297b1ec15a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec161 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813201.411658:0:12964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214da00/0x1b294f297b1ec15a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b294f297b1ec161 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813201.411665:0:12964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff93ef4214da00/0x1b294f297b1ec15a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b294f297b1ec161 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.411721:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788813201.411728:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec233 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b294f297b1ec23a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.411735:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164fc00 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:2.0:1788813201.411738:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec233 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b294f297b1ec23a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.411747:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec233 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b294f297b1ec23a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813201.411754:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec233 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b294f297b1ec23a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813201.411759:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788813201.411762:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788813201.411821:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec233 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b294f297b1ec23a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.411827:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813201.411858:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec233 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b294f297b1ec23a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.411874:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ec233 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b294f297b1ec23a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.411899:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813201.411903:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef4214da00/0x1b294f297b1ec15a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b294f297b1ec161 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.411909:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214da00 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:2.0:1788813201.411912:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214da00/0x1b294f297b1ec15a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b294f297b1ec161 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.411918:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef4214da00/0x1b294f297b1ec15a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b294f297b1ec161 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813201.411924:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214da00/0x1b294f297b1ec15a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b294f297b1ec161 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813201.411929:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788813201.411932:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1788813201.411945:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef4214da00/0x1b294f297b1ec15a lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b294f297b1ec161 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.411951:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813201.411975:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef4214da00/0x1b294f297b1ec15a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b294f297b1ec161 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.411983:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813201.411985:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813201.411986:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813201.412003:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3658b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322697216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813201.412066:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813201.412126:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322697216 00000100:00100000:2.0:1788813201.412139:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322697216 00000100:00100000:2.0:1788813201.412205:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788813201.412212:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3658bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+18:3299:x1875706322697216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813201.412223:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813201.412235:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef00030400/0x1b294f297b1ec161 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b294f297b1ec15a expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.412267:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813201.412301:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3658bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:3299:x1875706322697216:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813201.412308:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788813201.412343:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3658b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322697216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813201.412358:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813201.412365:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3658b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322697088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813201.412386:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813201.412731:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322697088 00000100:00100000:2.0:1788813201.412736:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322697088 00000100:00100000:2.0:1788813201.412767:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788813201.412773:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3658b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+17:3301:x1875706322697088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813201.412911:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813201.412923:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef4214de00/0x1b294f297b1ec23a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b294f297b1ec233 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.412938:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813201.412972:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3658b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:3301:x1875706322697088:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813201.412979:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788813201.413013:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3658b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322697088:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813201.413323:0:12964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788813201.413330:0:12964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef4214da00/0x1b294f297b1ec15a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b294f297b1ec161 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813201.413346:0:12964:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788813201.413366:0:12964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef354fda00/0x1b294f297b1ec44e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec455 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813201.413382:0:12964:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef354fda00/0x1b294f297b1ec44e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec455 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813201.413389:0:12964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef354fda00/0x1b294f297b1ec44e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b294f297b1ec455 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813201.413396:0:12964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff93ef354fda00/0x1b294f297b1ec44e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b294f297b1ec455 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.413494:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813201.413500:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef354fda00/0x1b294f297b1ec44e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b294f297b1ec455 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.413508:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fda00 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:2.0:1788813201.413511:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef354fda00/0x1b294f297b1ec44e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b294f297b1ec455 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.413519:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef354fda00/0x1b294f297b1ec44e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b294f297b1ec455 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813201.413526:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef354fda00/0x1b294f297b1ec44e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b294f297b1ec455 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813201.413532:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788813201.413535:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788813201.413555:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef354fda00/0x1b294f297b1ec44e lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b294f297b1ec455 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.413562:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788813201.413626:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1788813201.413646:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef354fda00/0x1b294f297b1ec44e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b294f297b1ec455 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.413656:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813201.413658:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813201.413660:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813201.413693:0:12964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788813201.413698:0:12964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef354fda00/0x1b294f297b1ec44e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b294f297b1ec455 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813201.413708:0:12964:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788813201.413715:0:12964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef01516c00/0x1b294f297b1ebf0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ebf15 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813201.413722:0:12964:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef01516c00/0x1b294f297b1ebf0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ebf15 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813201.413729:0:12964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef01516c00/0x1b294f297b1ebf0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b294f297b1ebf15 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813201.413735:0:12964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff93ef01516c00/0x1b294f297b1ebf0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b294f297b1ebf15 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813201.413745:0:12964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788813201.413747:0:12964:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788813201.413750:0:12964:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788813201.413817:0:12964:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788813201.413821:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788813201.413827:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788813201.413832:0:12964:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788813201.413837:0:12964:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff93ee06e9b800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788813201.413843:0:12964:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff93ef1978b800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788813201.413848:0:12964:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff93ef370c3380) has exports, disconnecting them 00000020:00080000:0.0:1788813201.413852:0:12964:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93ee06e9b800), last request at 1788813196 00000020:00000080:0.0:1788813201.413859:0:12964:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ec122 00000100:00080000:0.0:1788813201.413884:0:12964:0:(import.c:65:import_set_state_nolock()) ffff93ee06e98000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788813201.413924:0:12964:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93ee06e9b800): rc 0 00000020:00000080:0.0:1788813201.413926:0:12964:0:(genops.c:885:class_export_put()) final put ffff93ee06e9b800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788813201.413935:0:12964:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93ef1978b800), last request at 1788813196 00000020:00000080:0.0:1788813201.413938:0:12964:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ec057 00000100:00080000:0.0:1788813201.413943:0:12964:0:(import.c:65:import_set_state_nolock()) ffff93ef1978d000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788813201.413950:0:12964:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93ef1978b800): rc 0 00000020:00000080:0.0:1788813201.413952:0:12964:0:(genops.c:885:class_export_put()) final put ffff93ef1978b800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1788813201.413957:0:12964:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa9e5c1c7fae0 00000100:00080000:0.0:1788813201.413974:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788813201.413977:0:12964:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1788813201.413987:0:12964:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788813201.414052:0:12964:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788813201.414067:0:12964:0:(import.c:65:import_set_state_nolock()) ffff93ef19789800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788813201.414079:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788813201.414082:0:12964:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1788813201.414089:0:12964:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788813201.414341:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef354c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1875706322697472:0@lo:9:umount.0 00000100:00100000:0.0:1788813201.414387:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788813201.414521:0:12964:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788813201.414534:0:12964:0:(import.c:65:import_set_state_nolock()) ffff93ee051fa000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788813201.414553:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee07d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1875706322697600:0@lo:9:umount.0 00000100:00100000:0.0:1788813201.414579:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788813201.414633:0:1248:0:(genops.c:844:class_export_destroy()) destroying export ffff93ee06e9b800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788813201.414688:0:1248:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef1978b800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788813201.414709:0:1248:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93ee06e98000 for lustre-MDT0000 00000020:00000080:2.0:1788813201.414713:0:1248:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93ef1978d000 for lustre-MDT0000 00010000:00010000:2.0:1788813201.414732:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813201.414737:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef01516c00/0x1b294f297b1ebf0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b294f297b1ebf15 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.414745:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef01516c00 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:2.0:1788813201.414748:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef01516c00/0x1b294f297b1ebf0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b294f297b1ebf15 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.414756:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef01516c00/0x1b294f297b1ebf0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b294f297b1ebf15 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813201.414763:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef01516c00/0x1b294f297b1ebf0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b294f297b1ebf15 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813201.414768:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788813201.414771:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788813201.414774:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788813201.414810:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef01516c00/0x1b294f297b1ebf0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b294f297b1ebf15 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.414817:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813201.414833:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef01516c00/0x1b294f297b1ebf0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b294f297b1ebf15 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.414839:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef01516c00/0x1b294f297b1ebf0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b294f297b1ebf15 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.414852:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813201.414854:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813201.414856:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813201.414873:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788813201.414888:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322697728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813201.414917:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813201.414954:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322697728 00000100:00100000:2.0:1788813201.414961:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322697728 00000100:00100000:2.0:1788813201.415000:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788813201.415007:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36162a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+16:3302:x1875706322697728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813201.415018:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813201.415031:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef4214dc00/0x1b294f297b1ebf15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b294f297b1ebf0e expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.415044:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813201.415074:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36162a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:3302:x1875706322697728:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813201.415079:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788813201.415112:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322697728:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813201.415131:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813201.415543:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3658b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322697344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813201.415577:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813201.415653:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322697344 00000100:00100000:2.0:1788813201.415658:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322697344 00000100:00100000:2.0:1788813201.415696:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788813201.415704:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+15:3299:x1875706322697344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813201.415712:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813201.415722:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef1164f600/0x1b294f297b1ec455 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b294f297b1ec44e expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813201.415734:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813201.415764:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f07e87b1-ea56-4ba9-97bf-449134c6ff58+14:3299:x1875706322697344:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813201.415769:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788813201.415833:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3658b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3299:1875706322697344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788813201.416158:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322697472 00000100:00100000:3.0:1788813201.416164:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322697472 00000020:00080000:0.0:1788813201.416234:0:12964:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff93ef370c3380) has no exports 00000100:00080000:0.0:1788813201.417024:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813201.418840:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322697600 00000100:00100000:2.0:1788813201.418851:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788813201.418853:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322697600 00000100:00100000:2.0:1788813201.418999:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef354c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1875706322697472:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788813201.419029:0:6676:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ec0a4 00000100:00080000:2.0:1788813201.419039:0:6676:0:(import.c:65:import_set_state_nolock()) ffff93ef12166000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788813201.419076:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000001:00000004:2.0:1788813201.419076:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788813201.419089:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1875706322697600:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788813201.419108:0:6677:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ec199 00000100:00080000:3.0:1788813201.419115:0:6677:0:(import.c:65:import_set_state_nolock()) ffff93ee051fd800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788813201.419148:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788813201.419708:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef354c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3298:x1875706322697472:12345-0@lo:9:umount.0 Request processed in 845us (5319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813201.419717:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788813201.419770:0:3298:0:(import.c:65:import_set_state_nolock()) ffff93ef19789800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788813201.419852:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3298:x1875706322697600:12345-0@lo:9:umount.0 Request processed in 766us (5271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813201.419871:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1788813201.419890:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788813201.419910:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788813201.419978:0:3298:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788813201.419992:0:3298:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788813201.419997:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef354c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1875706322697472:0@lo:9:umount.0 00000100:00080000:2.0:1788813201.420023:0:3298:0:(import.c:65:import_set_state_nolock()) ffff93ee051fa000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788813201.420030:0:3298:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788813201.420032:0:3298:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788813201.420034:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee07d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1875706322697600:0@lo:9:umount.0 00010000:00010000:2.0:1788813201.420049:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788813201.427239:0:12964:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff93ef370c3380) has no exports 00000020:00000080:0.0:1788813201.521311:0:12964:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ebf69 00000020:00000080:0.0:1788813201.521329:0:12964:0:(genops.c:885:class_export_put()) final put ffff93ef370d2000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788813201.521351:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788813201.521395:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef370d2000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788813201.521568:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788813201.521579:0:12964:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788813201.521585:0:12964:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff93ef12000000) has no exports 00000020:00000080:1.0:1788813201.521902:0:12964:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ebf62 00000020:00000080:1.0:1788813201.521911:0:12964:0:(genops.c:885:class_export_put()) final put ffff93ef3ad2f800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788813201.521971:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813201.521978:0:12964:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788813201.521981:0:12964:0:(genops.c:885:class_export_put()) final put ffff93ef3c2ce800/lustre-QMT0000_UUID 00000020:00000080:1.0:1788813201.521983:0:12964:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef3c2ce800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788813201.522002:0:12964:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788813201.522190:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef3ad2f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788813201.522244:0:12964:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93ef1972ec60 - data ffff93ef18381000/ffff93ef36b5d000 00000020:01000000:1.0:1788813201.522477:0:12964:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93ef2103bb40 - data ffff93ef0f76fe58/ffff93ef2166f400 00000001:00000004:0.0:1788813201.546981:0:12964:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1788813201.649741:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788813201.649752:0:12964:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1788813201.649774:0:12964:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788813201.649777:0:12964:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788813201.650432:0:6775:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788813201.650437:0:6775:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1788813201.650446:0:6775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788813201.651454:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788813201.651458:0:12964:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1788813201.651474:0:12964:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788813201.651475:0:12964:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788813201.652516:0:8100:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788813201.652522:0:8100:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1788813201.652533:0:8100:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788813201.713304:0:12964:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ebf31 00000020:00000080:2.0:1788813201.713316:0:12964:0:(genops.c:885:class_export_put()) final put ffff93ef370cc000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788813201.714537:0:12964:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ebf46 00000020:00000080:2.0:1788813201.714545:0:12964:0:(genops.c:885:class_export_put()) final put ffff93ef370d0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788813201.714651:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef370cc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788813201.714744:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788813201.714750:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813201.714758:0:12964:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788813201.714762:0:12964:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff93ef370c0000) has no exports 00000020:00000080:0.0:1788813201.714865:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef370d0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1788813201.715196:0:12964:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788813201.715206:0:12964:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ec184 00000020:00000080:2.0:1788813201.715211:0:12964:0:(genops.c:885:class_export_put()) final put ffff93ef36d82000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788813201.715225:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788813201.715230:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813201.715239:0:12964:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788813201.715242:0:12964:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff93ef3591b380) has no exports 00000020:00000080:2.0:1788813201.715259:0:12964:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ec17d 00000020:00000080:2.0:1788813201.715264:0:12964:0:(genops.c:885:class_export_put()) final put ffff93ef36d85800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788813201.715420:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef36d82000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788813201.715426:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef36d85800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788813201.716234:0:12964:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788813201.716239:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788813201.716243:0:12964:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1788813201.716258:0:12964:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788813201.716260:0:12964:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788813201.716341:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813201.716350:0:12964:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788813201.716355:0:12964:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ec09d 00000020:00000080:2.0:1788813201.716361:0:12964:0:(genops.c:885:class_export_put()) final put ffff93ef12167800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788813201.716441:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93ee051fa000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788813201.716447:0:37:0:(genops.c:885:class_export_put()) final put ffff93ef36d80800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788813201.716449:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef36d80800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788813201.716454:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788813201.716571:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788813201.716576:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813201.716645:0:12964:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788813201.716649:0:12964:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff93ef119e3380) has no exports 00000020:00000080:2.0:1788813201.716654:0:12964:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ec096 00000020:00000080:2.0:1788813201.716658:0:12964:0:(genops.c:885:class_export_put()) final put ffff93ef1978e000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788813201.716674:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef12167800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:2.0:1788813201.717258:0:12964:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788813201.717263:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788813201.717265:0:12964:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1788813201.717270:0:12964:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788813201.717272:0:12964:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788813201.717308:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef1978e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788813201.717471:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813201.717478:0:12964:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788813201.717512:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813201.717521:0:12964:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788813201.717525:0:12964:0:(genops.c:885:class_export_put()) final put ffff93ef370c8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788813201.717527:0:12964:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef370c8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788813201.717533:0:12964:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788813201.717765:0:12964:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ebf4d 00000020:00000080:2.0:1788813201.717771:0:12964:0:(genops.c:885:class_export_put()) final put ffff93ef370d6800/lustre-MDD0000_UUID 00000020:00000080:0.0:1788813201.717945:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93ef19789800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788813201.717952:0:37:0:(genops.c:885:class_export_put()) final put ffff93ee0532e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788813201.717954:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93ee0532e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788813201.717961:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788813201.718156:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788813201.718161:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813201.718166:0:12964:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788813201.718170:0:12964:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff93ef370c4d40) has no exports 00000020:00000080:2.0:1788813201.718188:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813201.718191:0:12964:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788813201.718195:0:12964:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ebf54 00000020:00000080:2.0:1788813201.718199:0:12964:0:(genops.c:885:class_export_put()) final put ffff93ef370d5000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788813201.718219:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef370d6800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788813201.718223:0:37:0:(genops.c:885:class_export_put()) final put ffff93ef370ca000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788813201.718225:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef370ca000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788813201.718229:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:2.0:1788813201.718516:0:12964:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93ef2171d800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788813201.718520:0:12964:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ef2171d800 3 00000020:01000004:2.0:1788813201.718523:0:12964:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93ef2171d800 from lustre-MDT0000 00000020:00000080:2.0:1788813201.718540:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813201.718544:0:12964:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788813201.718547:0:12964:0:(genops.c:885:class_export_put()) final put ffff93ef370cc800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788813201.718549:0:12964:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef370cc800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788813201.718556:0:12964:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788813201.718656:0:12964:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1788813201.718661:0:12964:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788813201.718664:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788813201.718667:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813201.718669:0:12964:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788813201.718675:0:12964:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff93ef20d9e800 f07e87b1-ea56-4ba9-97bf-449134c6ff58 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788813201.718681:0:12964:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff93ef120019c0) has exports, disconnecting them 00000020:00080000:2.0:1788813201.718686:0:12964:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff93ef20d9e800), last request at 1788812991 00000020:00000080:2.0:1788813201.718711:0:12964:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ebef2 00000020:00010000:2.0:1788813201.718715:0:12964:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93ef20d9e800: total 1 00000100:00080000:2.0:1788813201.718728:0:12964:0:(import.c:65:import_set_state_nolock()) ffff93ef0a1e2000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788813201.718799:0:12964:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93ef20d9e800): rc 0 00000020:00080000:2.0:1788813201.718804:0:12964:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff93ef120019c0) has no exports 00000020:00010000:3.0:1788813201.718983:0:5822:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93ef20d9e800: total 1 00010000:00010000:3.0:1788813201.719016:0:5822:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93ef20d9e800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788813201.719053:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef1164ea00/0x1b294f297b1ec00a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b294f297b1ec003 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813201.719074:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef1164fa00/0x1b294f297b1ec248 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b294f297b1ec241 expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813201.719086:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef00031800/0x1b294f297b1ec202 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b294f297b1ec1fb expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813201.719096:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef1164e800/0x1b294f297b1ec1f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b294f297b1ec1ed expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813201.719106:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef21618e00/0x1b294f297b1ec210 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b294f297b1ec209 expref: 5 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813201.719116:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef4214ca00/0x1b294f297b1ec21e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b294f297b1ec217 expref: 4 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813201.719129:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef21618200/0x1b294f297b1ec447 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b294f297b1ec440 expref: 3 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813201.719154:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef00031000/0x1b294f297b1ec439 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1b294f297b1ec432 expref: 2 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813201.719165:0:5822:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93ef20d9e800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788813201.719179:0:5822:0:(genops.c:885:class_export_put()) final put ffff93ef20d9e800/f07e87b1-ea56-4ba9-97bf-449134c6ff58 00000020:00000080:0.0:1788813201.719301:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef370d5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1788813201.719408:0:5828:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff93ef212f4800:5828] 1 exiting: rc = 0 00010000:00010000:3.0:1788813201.719528:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813201.719530:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813201.719532:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788813201.719552:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef20d9e800/f07e87b1-ea56-4ba9-97bf-449134c6ff58 for MGS 00000020:00000080:0.0:1788813201.719749:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93ef0a1e2000 for MGS 00000100:00100000:0.0:1788813201.719879:0:5829:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff93ef224bfa00:5829] 2 exiting: rc = 0 00000100:00100000:1.0:1788813201.720222:0:5827:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff93ef224be600:5827] 0 exiting: rc = 1 00000100:00100000:2.0:1788813201.720287:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720295:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720302:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720308:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720314:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720392:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720401:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720407:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720414:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720420:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720425:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720431:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720437:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720443:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720452:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720460:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720471:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720480:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720488:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720495:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720502:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720510:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720518:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720526:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720533:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720542:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720549:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720556:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720563:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720572:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720653:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720665:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720686:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720862:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720870:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720876:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.720881:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721166:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721176:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721181:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721187:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721193:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721199:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721205:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721211:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721217:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721222:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721228:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721234:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721240:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721245:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721262:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721268:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721275:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721281:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721288:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721294:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721299:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721304:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721310:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721317:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721392:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721398:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.721404:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1788813201.722191:0:12964:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788813201.722196:0:12964:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1788813201.723491:0:12964:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93ef1972e300 - data ffff93ef2afc6a20/ffff93ee06fee800 00000020:01000000:2.0:1788813201.723684:0:12964:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93ef2105b9c0 - data ffff93ef1803d870/ffff93ef20e89400 00000020:00000080:2.0:1788813201.724540:0:12964:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ebed6 00000020:00000080:2.0:1788813201.724548:0:12964:0:(genops.c:885:class_export_put()) final put ffff93ef194a8800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788813201.724655:0:12964:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93ef2171d800 from MGS, refs=2 00000020:01000004:2.0:1788813201.724659:0:12964:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ef2171d800 2 00000020:01000004:2.0:1788813201.724662:0:12964:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93ef2171d800 from MGS 00000020:00000080:2.0:1788813201.724811:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813201.724820:0:12964:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788813201.724823:0:12964:0:(genops.c:885:class_export_put()) final put ffff93ef194a8000/MGS 00000020:00000080:2.0:1788813201.724826:0:12964:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef194a8000/MGS for MGS 00000020:01000000:2.0:1788813201.724835:0:12964:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788813201.724906:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788813201.724910:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813201.724916:0:12964:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788813201.724921:0:12964:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff93ef370cf000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788813201.724927:0:12964:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff93ef370c19c0) has exports, disconnecting them 00000020:00080000:2.0:1788813201.724931:0:12964:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff93ef370cf000), last request at 1788812992 00000020:00000080:2.0:1788813201.724935:0:12964:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ebfa1 00000020:00080000:2.0:1788813201.724945:0:12964:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93ef370cf000): rc 0 00000020:00000080:2.0:1788813201.724948:0:12964:0:(genops.c:885:class_export_put()) final put ffff93ef370cf000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788813201.725651:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef194a8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788813201.726797:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef370cf000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788813201.727873:0:12964:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788813201.727880:0:12964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788813201.727896:0:12964:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788813201.727903:0:12964:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788813201.727977:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93ef3adf1000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788813201.728206:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788813201.728213:0:12964:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788813201.728219:0:12964:0:(genops.c:885:class_export_put()) final put ffff93ef2171a800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788813201.728222:0:12964:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef2171a800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788813201.728231:0:12964:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788813201.728298:0:12964:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ef2171d800 1 00000020:00000080:3.0:1788813201.728303:0:12964:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ebec8 00000020:00000080:3.0:1788813201.728310:0:12964:0:(genops.c:885:class_export_put()) final put ffff93ef194ac000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788813201.728497:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788813201.728502:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788813201.728507:0:12964:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788813201.728511:0:12964:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff93ef2a358000) has no exports 00000020:00000080:0.0:1788813201.730508:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef194ac000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788813201.773505:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788813201.773519:0:12964:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788813201.773524:0:12964:0:(genops.c:885:class_export_put()) final put ffff93ef21719000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788813201.773529:0:12964:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef21719000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788813201.773538:0:12964:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788813201.773691:0:12964:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93ef2171b000 00000020:01000000:0.0:1788813201.773712:0:12964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788813201.773726:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788813201.773731:0:12964:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788813201.773735:0:12964:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff93ef2a35cd40) has no exports 00000100:00100000:0.0:1788813201.773833:0:5834:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff93ef1b872e00:5834] 0 exiting: rc = 1 00000100:00100000:0.0:1788813201.773926:0:5836:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff93ef20e05200:5836] 2 exiting: rc = 0 00000100:00100000:2.0:1788813201.779163:0:7630:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff93ee06ed7400:7630] 3 exiting: rc = 0 00000100:00100000:2.0:1788813201.780018:0:5835:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff93ef0707ca00:5835] 1 exiting: rc = 0 00000100:00100000:3.0:1788813201.807272:0:8565:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff93ef36fb9200:8565] 4 exiting: rc = 0 00000100:00100000:0.0:1788813201.807502:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807511:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807517:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807522:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807528:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807533:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807544:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807550:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807555:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807562:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807568:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807573:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807590:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807597:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807607:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807615:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807622:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807629:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807637:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807644:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807651:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807658:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807665:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807673:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807681:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807689:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807698:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807706:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807713:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807721:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807728:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807735:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807742:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807749:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807757:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807778:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807806:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807816:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807827:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807837:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807845:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807855:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807862:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807868:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807876:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807881:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807887:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807892:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807897:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807902:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807907:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807913:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807919:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807925:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807931:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807937:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807943:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807949:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807954:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807961:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807967:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807972:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807977:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813201.807983:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.815217:0:5838:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff93ef0707d600:5838] 1 exiting: rc = 0 00000100:00100000:0.0:1788813201.815331:0:5837:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff93ef213d0e00:5837] 0 exiting: rc = 1 00000100:00100000:2.0:1788813201.815414:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815423:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815430:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815436:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815442:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815448:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815454:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815460:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815466:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815471:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815492:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815497:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815503:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815508:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815513:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815518:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815523:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815528:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815534:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815540:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815545:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815550:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815556:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815562:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815566:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815571:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815576:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815582:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815588:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815593:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815599:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815604:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815610:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815615:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815621:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815626:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815631:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815636:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815642:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815648:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815654:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815664:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815669:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815675:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815680:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815693:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815698:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815702:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815708:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815714:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815719:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815724:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815729:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815735:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815740:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815745:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815750:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815756:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815761:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815766:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815771:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815776:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815812:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.815819:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.816454:0:5840:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff93ef11ec1000:5840] 1 exiting: rc = 0 00000100:00100000:0.0:1788813201.816655:0:5839:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff93ef1b872800:5839] 0 exiting: rc = 1 00000100:00100000:2.0:1788813201.816905:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.816912:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.816918:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.816924:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.816931:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.816939:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.816948:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.816956:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.816968:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.816995:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817005:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817013:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817435:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817449:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817457:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817466:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817487:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817495:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817503:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817512:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817520:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817549:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817563:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817574:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817580:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817586:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817592:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817597:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817602:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817609:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817615:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817620:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817626:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817648:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817655:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817662:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817668:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817674:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817680:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817685:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817692:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817698:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817704:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817710:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817716:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817736:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817743:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817749:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817754:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817761:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.817775:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.818478:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.818486:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.818495:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.818504:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.818513:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.818521:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.818555:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.818564:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.818575:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.818583:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.818589:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.818604:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.818628:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.836339:0:5842:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff93ef10e72e00:5842] 1 exiting: rc = 0 00000100:00100000:0.0:1788813201.836521:0:5841:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff93ef123ca000:5841] 0 exiting: rc = 1 00000100:00100000:3.0:1788813201.842346:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842356:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842380:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842385:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842390:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842396:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842402:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842408:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842414:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842420:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842426:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842430:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842436:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842441:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842446:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842451:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842456:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842462:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842467:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842472:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842478:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842483:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842489:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842494:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842499:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842505:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842510:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842514:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842519:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842524:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842529:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842534:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842539:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842543:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842548:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842553:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842558:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842571:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842576:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842580:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842586:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842591:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842596:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842601:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842605:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842609:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842614:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842619:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842623:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842627:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842631:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842636:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842640:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842645:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842650:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842656:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842662:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842667:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842672:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842677:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842682:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842687:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842692:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.842697:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813201.844155:0:5843:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff93ef12692600:5843] 0 exiting: rc = 1 00000100:00100000:0.0:1788813201.844738:0:5844:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff93ef12692400:5844] 1 exiting: rc = 0 00000100:00100000:3.0:1788813201.844848:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.844855:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.844860:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.844865:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.844870:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.844876:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.844882:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.844887:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.844903:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.844908:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.844913:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.844918:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.844973:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.844980:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.844985:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.844991:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.844996:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845001:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845006:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845011:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845015:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845020:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845025:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845030:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845035:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845039:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845044:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845049:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845127:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845132:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845137:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845142:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845147:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845152:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845157:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845163:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845168:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845174:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845180:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845185:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845190:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845195:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845200:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845214:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845218:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845223:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845228:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845233:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845238:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845242:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845258:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845264:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845269:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845274:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845279:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845284:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845289:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845293:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845298:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845304:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845309:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845314:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845318:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845334:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.845678:0:5846:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff93ef212f4600:5846] 1 exiting: rc = 0 00000100:00100000:0.0:1788813201.849096:0:5845:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff93ef20e3a600:5845] 0 exiting: rc = 1 00000100:00100000:3.0:1788813201.849221:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849230:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849236:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849241:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849257:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849262:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849268:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849272:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849278:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849283:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849288:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849293:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849298:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849313:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849318:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849334:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849340:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849346:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849351:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849357:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849361:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849366:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849372:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849378:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849383:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849388:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849393:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849398:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849403:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849407:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849412:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849417:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849421:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849427:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849432:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849437:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849443:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849448:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849453:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849458:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849463:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849468:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849473:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849479:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849484:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849488:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849493:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849498:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849511:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849515:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849520:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849524:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849529:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849540:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849546:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849551:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849555:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849559:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849564:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849569:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849574:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849578:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849583:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.849588:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.850099:0:5849:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff93ef2a2be200:5849] 2 exiting: rc = 0 00000100:00100000:2.0:1788813201.850410:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff93ef20eb0e00:5848] 1 exiting: rc = 0 00000100:00100000:0.0:1788813201.851350:0:5847:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff93ef20eb0c00:5847] 0 exiting: rc = 1 00000100:00100000:3.0:1788813201.852308:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852318:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852323:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852328:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852334:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852339:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852345:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852351:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852357:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852363:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852369:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852374:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852380:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852386:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852391:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852397:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852402:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852407:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852427:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852432:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852437:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852443:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852448:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852464:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852470:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852476:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852481:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852486:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852491:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852498:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852505:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852512:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852517:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852523:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852528:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852534:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852539:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852546:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852551:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852556:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852561:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852566:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852572:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852577:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852582:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852587:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852592:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852612:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852618:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852623:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852629:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852634:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852638:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852650:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852656:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852662:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852667:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852672:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852678:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852682:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852687:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852694:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852700:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788813201.852705:0:12964:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788813201.860581:0:12964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813201.860595:0:12964:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788813201.860600:0:12964:0:(genops.c:885:class_export_put()) final put ffff93ef2171b800/MDS_uuid 00000020:00000080:2.0:1788813201.860605:0:12964:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef2171b800/MDS_uuid for MDS 00000020:01000000:2.0:1788813201.860615:0:12964:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788813201.860739:0:12964:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1788813202.077920:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36160700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322697984:0@lo:400:kworker.0 00000400:00000100:1.0:1788813202.077974:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875706322697984 offset 0 length 224: 4 00000100:00100000:2.0:1788813202.078295:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322697856:0@lo:400:kworker.0 00000400:00000100:2.0:1788813202.078328:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875706322697856 offset 0 length 224: 4 00000100:00100000:2.0:1788813202.078372:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1875706322698112:0@lo:400:kworker.0 00000400:00000100:2.0:1788813202.078393:0:3300:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875706322698112 offset 0 length 224: 4 00010000:00010000:3.0:1788813202.400323:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813203.421829:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813204.446282:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788813204.746158:0:13113:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788813204.769149:0:13113:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788813204.769200:0:13113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef00031e00/0x1b294f297b1ec209 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec210 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813204.769248:0:13113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef00031e00/0x1b294f297b1ec209 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec210 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813204.769255:0:13113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef00031e00/0x1b294f297b1ec209 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b294f297b1ec210 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813204.769262:0:13113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff93ef00031e00/0x1b294f297b1ec209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b294f297b1ec210 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813204.769314:0:13113:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788813204.769320:0:13113:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788813204.769349:0:13113:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788813204.769362:0:13113:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93ef36160700 x1875706322697984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813218 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813204.769381:0:13113:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788813204.769387:0:13113:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788813204.769409:0:13113:0:(import.c:65:import_set_state_nolock()) ffff93ee04b97000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788813204.769505:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36160700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322697984:0@lo:400:kworker.0 00000100:00100000:0.0:1788813204.769570:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36161180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1875706322698240:0@lo:39:umount.0 00000400:00000100:0.0:1788813204.769622:0:3298:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875706322698240 offset 0 length 224: 4 00010000:00010000:3.0:1788813204.769932:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813204.769941:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef00031e00/0x1b294f297b1ec209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b294f297b1ec210 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813204.769949:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef00031e00 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:3.0:1788813204.769952:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef00031e00/0x1b294f297b1ec209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b294f297b1ec210 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813204.769962:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef00031e00/0x1b294f297b1ec209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b294f297b1ec210 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813204.769969:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef00031e00/0x1b294f297b1ec209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b294f297b1ec210 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813204.769974:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788813204.769976:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788813204.769979:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788813204.770007:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef00031e00/0x1b294f297b1ec209 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b294f297b1ec210 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813204.770013:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788813204.770062:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322698368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813204.770100:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813204.770166:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322698368 00000100:00100000:0.0:1788813204.770173:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322698368 00000100:00100000:0.0:1788813204.770225:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788813204.770242:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36163100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3301:x1875706322698368:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788813204.770248:0:5819:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788813204 with bad export cookie 1957182552647057138 00010000:00010000:3.0:1788813204.770872:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef00031e00/0x1b294f297b1ec209 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b294f297b1ec210 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813204.770883:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef00031e00/0x1b294f297b1ec209 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1b294f297b1ec210 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813204.770898:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813204.771249:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813204.771254:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813204.781725:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36163100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3301:x1875706322698368:12345-0@lo:103:ldlm_bl.0 Request processed in 11474us (11616us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788813204.781739:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788813204.781938:0:3301:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.113@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788813204.781943:0:3301:0:(import.c:65:import_set_state_nolock()) ffff93ef2171d000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788813204.781947:0:3301:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.113@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788813204.789878:0:3301:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.113@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788813204.789884:0:3301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788813204.789893:0:3301:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93ef36160a80 x1875706322697856/t0(0) o400->MGC192.168.203.113@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788813218 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813204.789936:0:3301:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93ef3ae7ad80 x1875706322698368/t0(0) o103->MGC192.168.203.113@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788813220 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788813204.789946:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788813204.789948:0:3301:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788813204.789950:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788813204.789954:0:3301:0:(import.c:65:import_set_state_nolock()) ffff93ef2171d000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788813204.789959:0:3301:0:(import.c:545:import_select_connection()) MGC192.168.203.113@tcp: connect to NID 0@lo last attempt 151 00000100:00080000:2.0:1788813204.789973:0:3301:0:(import.c:666:import_select_connection()) MGC192.168.203.113@tcp: import ffff93ef2171d000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788813204.791495:0:3301:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ef36163800 x1875706322698496/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788813204.791596:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36163800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3298:1875706322698496:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1788813204.791665:0:3298:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875706322698496 offset 0 length 520: 4 00000100:00100000:1.0:1788813204.791840:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3302:1875706322697856:0@lo:400:kworker.0 00000100:00100000:2.0:1788813204.791927:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3301:1875706322698368:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813205.470931:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788813205.715468:0:6700:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788813205.715477:0:6700:0:(genops.c:885:class_export_put()) final put ffff93ef12165800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788813205.715615:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef12165800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788813205.715674:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93ef12166000 for lustre-OST0000 00000001:00100000:1.0:1788813206.261235:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788813206.261244:0:7632:0:(genops.c:885:class_export_put()) final put ffff93ee051fe000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788813206.261416:0:1248:0:(genops.c:844:class_export_destroy()) destroying export ffff93ee051fe000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788813206.261464:0:1248:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93ee051fd800 for lustre-OST0001 00010000:00010000:3.0:1788813206.494818:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788813207.197058:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) f07e87b1-ea56-4ba9-97bf-449134c6ff58->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788813207.197068:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) f07e87b1-ea56-4ba9-97bf-449134c6ff58->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788813207.197173:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813207.197191:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322698624:0@lo:400:kworker.0 00000400:00000100:3.0:1788813207.197260:0:3301:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875706322698624 offset 0 length 224: 4 00010000:00010000:0.0:1788813207.517033:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813208.541021:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813209.565255:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788813210.204996:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) f07e87b1-ea56-4ba9-97bf-449134c6ff58->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788813210.205007:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) f07e87b1-ea56-4ba9-97bf-449134c6ff58->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788813210.205174:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813210.205206:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1875706322698752:0@lo:400:kworker.0 00000400:00000100:2.0:1788813210.205263:0:3300:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875706322698752 offset 0 length 224: 4 00010000:00010000:3.0:1788813210.591984:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813211.613029:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813212.638077:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813213.661536:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813214.364946:0:3298:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813204/real 1788813204] req@ffff93ef36163800 x1875706322698496/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788813214 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813214.364982:0:3298:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93ef36163800 x1875706322698496/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788813214 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813214.364993:0:3298:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813204/real 1788813204] req@ffff93ef36161180 x1875706322698240/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788813214 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813214.365005:0:3298:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93ef36161180 x1875706322698240/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788813214 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788813214.365024:0:3298:0:(import.c:65:import_set_state_nolock()) ffff93ef2171d000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788813214.365047:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788813214.365069:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36163800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3298:1875706322698496:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1788813214.365075:0:3298:0:(import.c:65:import_set_state_nolock()) ffff93ee04b97000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788813214.365101:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36161180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1875706322698240:0@lo:39:umount.0 00000100:00080000:3.0:1788813214.365132:0:1248:0:(pinger.c:229:ptlrpc_pinger_process_import()) f07e87b1-ea56-4ba9-97bf-449134c6ff58->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788813214.365143:0:1248:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788813214.365148:0:1248:0:(import.c:65:import_set_state_nolock()) ffff93ef2171d000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788813214.365157:0:1248:0:(import.c:545:import_select_connection()) MGC192.168.203.113@tcp: connect to NID 0@lo last attempt 365 00000100:00080000:3.0:1788813214.365177:0:1248:0:(import.c:630:import_select_connection()) MGC192.168.203.113@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788813214.365194:0:1248:0:(import.c:666:import_select_connection()) MGC192.168.203.113@tcp: import ffff93ef2171d000 using connection 192.168.203.113@tcp/0@lo 00000100:00080000:0.0:1788813214.365238:0:13113:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788813214.365244:0:1248:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ef3ae7ad80 x1875706322698880/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788813214.365246:0:13113:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788813214.365255:0:13113:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1788813214.365359:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813214.365391:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1875706322699008:0@lo:400:kworker.0 00000400:00000100:3.0:1788813214.365687:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875706322699008 offset 0 length 224: 4 00000100:00100000:2.0:1788813214.367014:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3298:1875706322698880:0@lo:250:kworker.0 00000400:00000100:2.0:1788813214.367071:0:3298:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875706322698880 offset 0 length 520: 4 00010000:00010000:0.0:1788813214.369550:0:13113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef00030600/0x1b294f297b1ec217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec21e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813214.369583:0:13113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef00030600/0x1b294f297b1ec217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec21e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813214.369590:0:13113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef00030600/0x1b294f297b1ec217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b294f297b1ec21e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813214.369597:0:13113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff93ef00030600/0x1b294f297b1ec217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b294f297b1ec21e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813214.369626:0:13113:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813214.369635:0:13113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef354fc600/0x1b294f297b1ec440 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec447 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813214.369642:0:13113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef354fc600/0x1b294f297b1ec440 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec447 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813214.369648:0:13113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef354fc600/0x1b294f297b1ec440 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b294f297b1ec447 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813214.369654:0:13113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff93ef354fc600/0x1b294f297b1ec440 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b294f297b1ec447 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813214.369819:0:13113:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788813214.369825:0:13113:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788813214.369851:0:13113:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788813214.369856:0:13113:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788813214.369860:0:13113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788813214.369865:0:13113:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788813214.369870:0:13113:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff93ef2a3599c0) has no exports 00000020:00080000:0.0:1788813214.369898:0:13113:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff93ef2a3599c0) has no exports 00000020:01000000:0.0:1788813214.371600:0:13113:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93ef24b17d80 - data ffff93ef0f71bd80/ffff93ef3690c800 00000020:01000000:0.0:1788813214.371732:0:13113:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93ef196e3d80 - data ffff93ef0f7b2438/ffff93ef36aa7400 00010000:00010000:1.0:1788813214.381271:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813214.381286:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef00030600/0x1b294f297b1ec217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b294f297b1ec21e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813214.381298:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef00030600 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:1.0:1788813214.381303:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef00030600/0x1b294f297b1ec217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b294f297b1ec21e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813214.381313:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef00030600/0x1b294f297b1ec217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b294f297b1ec21e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813214.381321:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef00030600/0x1b294f297b1ec217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b294f297b1ec21e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813214.381327:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788813214.381329:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788813214.381350:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788813214.381368:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93ef2171d000 00010000:00010000:1.0:1788813214.381373:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef00030600/0x1b294f297b1ec217 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x1b294f297b1ec21e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813214.381380:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef00030600/0x1b294f297b1ec217 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x1b294f297b1ec21e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813214.381394:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813214.381398:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef354fc600/0x1b294f297b1ec440 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b294f297b1ec447 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813214.381404:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fc600 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:1.0:1788813214.381407:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef354fc600/0x1b294f297b1ec440 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b294f297b1ec447 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813214.381415:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef354fc600/0x1b294f297b1ec440 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b294f297b1ec447 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813214.381420:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef354fc600/0x1b294f297b1ec440 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b294f297b1ec447 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813214.381425:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788813214.381427:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788813214.381429:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788813214.381433:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93ef2171d000 00010000:00010000:1.0:1788813214.381436:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef354fc600/0x1b294f297b1ec440 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1b294f297b1ec447 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813214.381442:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef354fc600/0x1b294f297b1ec440 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1b294f297b1ec447 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813214.381462:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813214.381463:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813214.381466:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813214.383471:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788813214.388319:0:13113:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788813214.431757:0:13113:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ec026 00000020:00000080:0.0:1788813214.431767:0:13113:0:(genops.c:885:class_export_put()) final put ffff93ee04b95800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788813214.431804:0:13113:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93ef197e7800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788813214.431807:0:13113:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ef197e7800 2 00000020:01000004:0.0:1788813214.431810:0:13113:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93ef197e7800 from lustre-OST0000 00000020:00000080:0.0:1788813214.431831:0:13113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788813214.431841:0:13113:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788813214.431843:0:13113:0:(genops.c:885:class_export_put()) final put ffff93ee04b94000/lustre-OST0000_UUID 00000020:00000080:0.0:1788813214.431846:0:13113:0:(genops.c:844:class_export_destroy()) destroying export ffff93ee04b94000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788813214.431853:0:13113:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788813214.432046:0:13113:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788813214.432051:0:13113:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788813214.432067:0:13113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788813214.432073:0:13113:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788813214.432079:0:13113:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff93ef19788000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788813214.432085:0:13113:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff93ef119e0000) has exports, disconnecting them 00000020:00080000:0.0:1788813214.432090:0:13113:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff93ef19788000), last request at 1788813005 00000020:00000080:0.0:1788813214.432094:0:13113:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ec050 00000020:00080000:0.0:1788813214.432104:0:13113:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93ef19788000): rc 0 00000020:00000080:0.0:1788813214.432109:0:13113:0:(genops.c:885:class_export_put()) final put ffff93ef19788000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788813214.432447:0:1248:0:(genops.c:844:class_export_destroy()) destroying export ffff93ee04b95800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788813214.432462:0:1248:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef19788000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788813214.434410:0:13113:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788813214.434418:0:13113:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788813214.434423:0:13113:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788813214.434429:0:13113:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788813214.434490:0:1248:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93ee04b97000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788813214.434593:0:13113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813214.434600:0:13113:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788813214.434605:0:13113:0:(genops.c:885:class_export_put()) final put ffff93ee04b91800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788813214.434609:0:13113:0:(genops.c:844:class_export_destroy()) destroying export ffff93ee04b91800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788813214.434631:0:13113:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1788813214.434683:0:13113:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ef197e7800 1 00000020:00000080:1.0:1788813214.434688:0:13113:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ebfe0 00000020:00000080:1.0:1788813214.434695:0:13113:0:(genops.c:885:class_export_put()) final put ffff93ef2a2ad000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788813214.434713:0:13113:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788813214.434718:0:13113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788813214.434722:0:13113:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788813214.434725:0:13113:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff93ef35918000) has no exports 00000020:00000080:2.0:1788813214.434749:0:1248:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef2a2ad000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788813214.494305:0:13113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813214.494324:0:13113:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788813214.494329:0:13113:0:(genops.c:885:class_export_put()) final put ffff93ef197e3000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788813214.494334:0:13113:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef197e3000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788813214.494360:0:13113:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788813214.494680:0:13113:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93ef197e0800 00000020:02000400:1.0:1788813214.494732:0:13113:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788813214.692190:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813215.709027:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813216.732911:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788813217.108443:0:13265:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788813217.126729:0:13265:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788813217.126834:0:13265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214c000/0x1b294f297b1ec1ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec1f4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813217.126851:0:13265:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214c000/0x1b294f297b1ec1ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec1f4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813217.126876:0:13265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214c000/0x1b294f297b1ec1ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b294f297b1ec1f4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813217.126882:0:13265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff93ef4214c000/0x1b294f297b1ec1ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b294f297b1ec1f4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813217.126896:0:13265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788813217.126901:0:13265:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788813217.126923:0:13265:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788813217.126935:0:13265:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93ef36163480 x1875706322698112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813218 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813217.126949:0:13265:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93ef36ec8700 x1875706322698624/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813223 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813217.126959:0:13265:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93ef36ec8a80 x1875706322698752/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813226 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813217.126967:0:13265:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93ef3ae78a80 x1875706322699008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813230 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813217.126982:0:13265:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788813217.126988:0:13265:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788813217.127154:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1875706322699008:0@lo:400:kworker.0 00010000:00010000:3.0:1788813217.127326:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813217.127334:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef4214c000/0x1b294f297b1ec1ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b294f297b1ec1f4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813217.127343:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214c000 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:3.0:1788813217.127346:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214c000/0x1b294f297b1ec1ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b294f297b1ec1f4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813217.127355:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef4214c000/0x1b294f297b1ec1ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b294f297b1ec1f4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813217.127363:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214c000/0x1b294f297b1ec1ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b294f297b1ec1f4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813217.127369:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788813217.127371:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788813217.127373:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788813217.127386:0:5822:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93ef2171d000 00010000:00010000:3.0:1788813217.127390:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef4214c000/0x1b294f297b1ec1ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1b294f297b1ec1f4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813217.127397:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef4214c000/0x1b294f297b1ec1ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1b294f297b1ec1f4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813217.127408:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813217.127410:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813217.127417:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813217.127436:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1875706322698752:0@lo:400:kworker.0 00000100:00100000:3.0:1788813217.127444:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1875706322698112:0@lo:400:kworker.0 00000100:00100000:3.0:1788813217.127474:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322698624:0@lo:400:kworker.0 00000100:00080000:0.0:1788813217.128112:0:13265:0:(import.c:65:import_set_state_nolock()) ffff93ee05212800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788813217.128400:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1875706322699136:0@lo:39:umount.0 00000400:00000100:1.0:1788813217.128448:0:3298:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875706322699136 offset 0 length 224: 4 00010000:00010000:1.0:1788813217.757760:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813218.780996:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788813219.486176:0:1248:0:(pinger.c:229:ptlrpc_pinger_process_import()) f07e87b1-ea56-4ba9-97bf-449134c6ff58->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788813219.486186:0:1248:0:(pinger.c:247:ptlrpc_pinger_process_import()) f07e87b1-ea56-4ba9-97bf-449134c6ff58->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788813219.804968:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813220.829441:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813221.853007:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813222.877632:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813223.901154:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788813224.604918:0:1248:0:(pinger.c:229:ptlrpc_pinger_process_import()) f07e87b1-ea56-4ba9-97bf-449134c6ff58->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788813224.604928:0:1248:0:(pinger.c:247:ptlrpc_pinger_process_import()) f07e87b1-ea56-4ba9-97bf-449134c6ff58->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788813224.925027:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813225.950486:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813226.973058:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813227.356921:0:3298:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813217/real 1788813217] req@ffff93ef36ecbb80 x1875706322699136/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788813227 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813227.356951:0:3298:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93ef36ecbb80 x1875706322699136/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788813227 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788813227.356971:0:3298:0:(import.c:65:import_set_state_nolock()) ffff93ee05212800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788813227.356993:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1875706322699136:0@lo:39:umount.0 00000100:00080000:0.0:1788813227.357140:0:13265:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788813227.357145:0:13265:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788813227.357158:0:13265:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788813227.358083:0:13265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec1fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec202 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813227.358098:0:13265:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec1fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec202 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813227.358117:0:13265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec1fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b294f297b1ec202 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813227.358123:0:13265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec1fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b294f297b1ec202 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813227.358147:0:13265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813227.358154:0:13265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164ec00/0x1b294f297b1ec432 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ec439 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813227.358161:0:13265:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164ec00/0x1b294f297b1ec432 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ec439 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813227.358167:0:13265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164ec00/0x1b294f297b1ec432 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b294f297b1ec439 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813227.358173:0:13265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff93ef1164ec00/0x1b294f297b1ec432 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1b294f297b1ec439 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813227.358188:0:13265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788813227.358192:0:13265:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788813227.358213:0:13265:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788813227.358216:0:13265:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788813227.358221:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788813227.358226:0:13265:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788813227.358230:0:13265:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff93ef119e19c0) has no exports 00000020:00080000:0.0:1788813227.358251:0:13265:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff93ef119e19c0) has no exports 00000020:01000000:0.0:1788813227.359890:0:13265:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93ef24b17360 - data ffff93ef2ac2e6c0/ffff93ef3690d800 00000020:01000000:0.0:1788813227.360019:0:13265:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93ef354c0a20 - data ffff93ef2aef9948/ffff93ef36d00c00 00010000:00010000:1.0:1788813227.360556:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813227.360568:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec1fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b294f297b1ec202 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813227.360580:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e400 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:1.0:1788813227.360584:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec1fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b294f297b1ec202 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813227.360612:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec1fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b294f297b1ec202 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813227.360620:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec1fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b294f297b1ec202 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813227.360626:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788813227.360628:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788813227.360630:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788813227.360646:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93ef2171d000 00010000:00010000:1.0:1788813227.360650:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec1fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1b294f297b1ec202 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813227.360656:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef1164e400/0x1b294f297b1ec1fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1b294f297b1ec202 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813227.360669:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813227.360673:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef1164ec00/0x1b294f297b1ec432 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b294f297b1ec439 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813227.360678:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164ec00 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:1.0:1788813227.360681:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef1164ec00/0x1b294f297b1ec432 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1b294f297b1ec439 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813227.360688:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef1164ec00/0x1b294f297b1ec432 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b294f297b1ec439 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813227.360694:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef1164ec00/0x1b294f297b1ec432 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b294f297b1ec439 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813227.360708:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788813227.360710:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788813227.360713:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788813227.360719:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93ef2171d000 00010000:00010000:1.0:1788813227.360722:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef1164ec00/0x1b294f297b1ec432 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1b294f297b1ec439 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813227.360728:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef1164ec00/0x1b294f297b1ec432 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1b294f297b1ec439 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813227.360740:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813227.360742:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813227.360744:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813227.360865:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788813227.399487:0:13265:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788813227.436678:0:13265:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ec0f1 00000020:00000080:3.0:1788813227.436689:0:13265:0:(genops.c:885:class_export_put()) final put ffff93ee06e9e000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788813227.436703:0:13265:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93ee0532b000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788813227.436707:0:13265:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ee0532b000 2 00000020:01000004:3.0:1788813227.436710:0:13265:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93ee0532b000 from lustre-OST0001 00000020:00000080:3.0:1788813227.436732:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788813227.436742:0:13265:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788813227.436745:0:13265:0:(genops.c:885:class_export_put()) final put ffff93ee06e9c800/lustre-OST0001_UUID 00000020:00000080:3.0:1788813227.436748:0:13265:0:(genops.c:844:class_export_destroy()) destroying export ffff93ee06e9c800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788813227.436756:0:13265:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:2.0:1788813227.437240:0:1248:0:(genops.c:844:class_export_destroy()) destroying export ffff93ee06e9e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:3.0:1788813227.437359:0:13265:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import f07e87b1-ea56-4ba9-97bf-449134c6ff58->MGS 00010000:00010000:3.0:1788813227.437374:0:13265:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef4214c400/0x1b294f297b1ec003 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b294f297b1ec00a expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813227.437387:0:13265:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef4214c400/0x1b294f297b1ec003 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b294f297b1ec00a expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813227.437394:0:13265:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788813227.437397:0:13265:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788813227.437409:0:13265:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788813227.437423:0:13265:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93ef2171d000 00010000:00010000:3.0:1788813227.437427:0:13265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef4214c400/0x1b294f297b1ec003 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1b294f297b1ec00a expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813227.437452:0:13265:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef21619600/0x1b294f297b1ec241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1b294f297b1ec248 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813227.437478:0:13265:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef21619600/0x1b294f297b1ec241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1b294f297b1ec248 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813227.437484:0:13265:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788813227.437486:0:13265:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788813227.437488:0:13265:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788813227.437498:0:13265:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93ef2171d000 00010000:00010000:3.0:1788813227.437501:0:13265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef21619600/0x1b294f297b1ec241 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1b294f297b1ec248 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788813227.437592:0:13265:0:(import.c:65:import_set_state_nolock()) ffff93ef2171d000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788813227.437597:0:13265:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788813227.437599:0:13265:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788813227.437600:0:13265:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788813227.437604:0:13265:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788813227.437613:0:13265:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93ef3ae7ad80 x1875706322698880/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788813229 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788813227.437635:0:13265:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788813227.437638:0:13265:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:2.0:1788813227.437706:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f07e87b1-ea56-4ba9-97bf-449134c6ff58:3298:1875706322698880:0@lo:250:kworker.0 10000000:01000000:3.0:1788813227.438061:0:13265:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788813227.438077:0:13265:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ebee4 00000020:00000080:3.0:1788813227.438083:0:13265:0:(genops.c:885:class_export_put()) final put ffff93ef21718000/f07e87b1-ea56-4ba9-97bf-449134c6ff58 00000020:01000000:3.0:1788813227.438095:0:13265:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.113@tcp (flags='') 00000020:00000080:3.0:1788813227.438101:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788813227.438112:0:13265:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.113@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788813227.438115:0:13265:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff93ef2a35b380) has no exports 00000020:00000080:2.0:1788813227.438151:0:1248:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef21718000/f07e87b1-ea56-4ba9-97bf-449134c6ff58 for MGC192.168.203.113@tcp 10000000:01000000:2.0:1788813227.438427:0:5831:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788813227.438620:0:13265:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.113@tcp: client import never connected 00000100:00080000:3.0:1788813227.438623:0:13265:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788813227.438625:0:13265:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788813227.438627:0:13265:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788813227.438629:0:13265:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788813227.438672:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788813227.438678:0:13265:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.113@tcp (uuid f07e87b1-ea56-4ba9-97bf-449134c6ff58) 00000020:01000000:3.0:1788813227.438684:0:13265:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788813227.438689:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788813227.438692:0:13265:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788813227.438697:0:13265:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff93ee05213800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788813227.438703:0:13265:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff93ef355ccd40) has exports, disconnecting them 00000020:00080000:3.0:1788813227.438707:0:13265:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff93ee05213800), last request at 1788813019 00000020:00000080:3.0:1788813227.438711:0:13265:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ec11b 00000020:00080000:3.0:1788813227.438722:0:13265:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93ee05213800): rc 0 00000020:00000080:3.0:1788813227.438726:0:13265:0:(genops.c:885:class_export_put()) final put ffff93ee05213800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788813227.439058:0:1248:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93ef2171d000 for MGC192.168.203.113@tcp 00000020:00000080:2.0:1788813227.439065:0:1248:0:(genops.c:885:class_export_put()) final put ffff93ef2171c000/f07e87b1-ea56-4ba9-97bf-449134c6ff58 00000020:00000080:2.0:1788813227.439068:0:1248:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef2171c000/f07e87b1-ea56-4ba9-97bf-449134c6ff58 for MGC192.168.203.113@tcp 00000020:01000000:2.0:1788813227.439082:0:1248:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.113@tcp (f07e87b1-ea56-4ba9-97bf-449134c6ff58) 00000020:00000080:2.0:1788813227.439329:0:1248:0:(genops.c:844:class_export_destroy()) destroying export ffff93ee05213800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788813227.441468:0:13265:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788813227.441478:0:13265:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788813227.441482:0:13265:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788813227.441491:0:13265:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788813227.441553:0:1248:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93ee05212800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788813227.442129:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788813227.444719:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:2.0:1788813227.445105:0:5816:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff93ef11782e00:5816] 0 exiting: rc = 1 00000100:00100000:0.0:1788813227.445551:0:5817:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff93ef11783e00:5817] 1 exiting: rc = 0 00000100:00100000:2.0:1788813227.445638:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.447634:0:5820:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff93ef224be200:5820] 2 exiting: rc = 0 00000100:00100000:0.0:1788813227.447887:0:5818:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff93ef224bec00:5818] 0 exiting: rc = 1 00000100:00100000:1.0:1788813227.448470:0:8439:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff93ef11763200:8439] 3 exiting: rc = 0 00000100:00100000:1.0:1788813227.448685:0:5819:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff93ef224be800:5819] 1 exiting: rc = 0 00000100:00100000:0.0:1788813227.449095:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449109:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449116:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449122:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449128:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449135:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449141:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449147:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449152:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449158:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449164:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449171:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449177:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449183:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449189:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449197:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449205:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449211:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449217:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449223:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449229:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449234:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449239:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449246:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449252:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449257:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449262:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449268:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449274:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449279:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449285:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449305:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449324:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449329:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449335:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449340:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449346:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449352:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449358:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449363:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449368:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449374:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449380:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449385:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449390:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449395:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449401:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449408:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449414:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449420:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449426:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449431:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449437:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449442:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449448:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449453:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449459:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449464:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449470:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449487:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449493:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449498:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449504:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.449509:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788813227.470529:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788813227.470541:0:13265:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788813227.470559:0:13265:0:(genops.c:885:class_export_put()) final put ffff93ee04b95000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788813227.470564:0:13265:0:(genops.c:844:class_export_destroy()) destroying export ffff93ee04b95000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788813227.470574:0:13265:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1788813227.470616:0:13265:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ee0532b000 1 00000020:00000080:0.0:1788813227.470622:0:13265:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1b294f297b1ec0c0 00000020:00000080:0.0:1788813227.470630:0:13265:0:(genops.c:885:class_export_put()) final put ffff93ee04b94800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788813227.470649:0:13265:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788813227.470655:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813227.470679:0:1248:0:(genops.c:844:class_export_destroy()) destroying export ffff93ee04b94800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788813227.470955:0:13265:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788813227.470961:0:13265:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff93ef119e4d40) has no exports 00000020:00000080:2.0:1788813227.498397:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813227.498411:0:13265:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788813227.498416:0:13265:0:(genops.c:885:class_export_put()) final put ffff93ee0532a800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788813227.498421:0:13265:0:(genops.c:844:class_export_destroy()) destroying export ffff93ee0532a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788813227.498432:0:13265:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788813227.499795:0:13265:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93ee05329800 00000020:01000000:2.0:1788813227.499820:0:13265:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788813227.500510:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813227.500583:0:13265:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788813227.500588:0:13265:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff93ef355cb380) has no exports 00000020:00000080:2.0:1788813227.500612:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813227.500623:0:13265:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788813227.500629:0:13265:0:(genops.c:885:class_export_put()) final put ffff93ef2a2ad800/OSS_uuid 00000020:00000080:2.0:1788813227.500633:0:13265:0:(genops.c:844:class_export_destroy()) destroying export ffff93ef2a2ad800/OSS_uuid for OSS 00000020:01000000:2.0:1788813227.500638:0:13265:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788813227.500733:0:6676:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff93ef21ebcc00:6676] 1 exiting: rc = 0 00000100:00080000:3.0:1788813227.500941:0:5830:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788813227.512167:0:8122:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff93ef21655e00:8122] 3 exiting: rc = 0 00000100:00100000:3.0:1788813227.514217:0:6677:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff93ef2a332200:6677] 2 exiting: rc = 0 00000100:00100000:1.0:1788813227.518376:0:6675:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff93ef19068400:6675] 0 exiting: rc = 1 00000100:00100000:0.0:1788813227.519197:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519209:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519216:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519226:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519232:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519237:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519243:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519248:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519254:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519259:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519264:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519269:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519274:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519280:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519285:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519290:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519296:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519301:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519306:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519311:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519316:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519321:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519326:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519350:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519356:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519361:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519367:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519372:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519377:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519382:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519387:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519392:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519402:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519408:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519413:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519419:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519424:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519429:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519444:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519451:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519456:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519461:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519467:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519472:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519476:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519482:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519488:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519493:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519498:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519503:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519508:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519523:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519529:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519533:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519538:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519543:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519548:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519553:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519567:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519573:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519579:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519584:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519589:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.519594:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.535444:0:6680:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff93ef0707e600:6680] 1 exiting: rc = 0 00000100:00100000:0.0:1788813227.536025:0:10074:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff93ef36b5b600:10074] 2 exiting: rc = 0 00000100:00100000:1.0:1788813227.539013:0:6678:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff93ef2a333a00:6678] 0 exiting: rc = 1 00000100:00100000:2.0:1788813227.543893:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.543916:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.543921:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.543927:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.543933:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.543938:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.543943:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.543948:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.543953:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.543957:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.543962:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.543967:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.543972:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.543995:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544000:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544004:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544009:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544013:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544018:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544023:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544028:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544034:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544039:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544044:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544049:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544054:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544059:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544064:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544079:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544085:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544090:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544095:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544100:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544106:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544110:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544114:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544119:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544152:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544160:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544165:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544169:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544174:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544179:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544185:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544190:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544195:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544199:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544204:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544217:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544222:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544226:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544230:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544235:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544239:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544244:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544249:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544253:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544258:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544262:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544267:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544272:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544277:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544282:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813227.544291:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.546159:0:6682:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff93ef0707ec00:6682] 1 exiting: rc = 0 00000100:00100000:2.0:1788813227.550175:0:6681:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff93ef0707e000:6681] 0 exiting: rc = 1 00000100:00100000:2.0:1788813227.552713:0:6683:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff93ef0707ee00:6683] 2 exiting: rc = 0 00000100:00100000:0.0:1788813227.552848:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.552857:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.552863:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.552869:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.552875:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.552881:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.552886:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.552891:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.552896:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.552903:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.552923:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.552931:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.552936:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.552942:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.552948:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.552953:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.552959:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.552964:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.552970:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.552975:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.552980:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.552986:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.552991:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.552996:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553002:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553008:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553013:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553033:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553038:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553044:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553049:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553054:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553060:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553065:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553095:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553102:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553107:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553113:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553118:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553123:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553129:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553135:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553141:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553147:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553152:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553158:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553163:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553169:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553175:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553182:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553187:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553192:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553198:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553202:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553207:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553213:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553218:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553223:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553244:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553260:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553267:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553272:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553286:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.553292:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.574217:0:6685:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff93ef0707e400:6685] 1 exiting: rc = 0 00000100:00100000:1.0:1788813227.577213:0:6684:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff93ef0707e800:6684] 0 exiting: rc = 1 00000100:00100000:0.0:1788813227.577448:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577457:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577462:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577467:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577472:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577477:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577482:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577487:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577492:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577498:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577503:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577508:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577523:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577529:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577535:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577539:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577544:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577550:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577555:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577560:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577566:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577570:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577575:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577580:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577586:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577592:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577598:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577603:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577608:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577614:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577618:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577623:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577640:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577645:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577650:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577655:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577660:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577664:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577670:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577675:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577679:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577684:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577688:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577692:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577696:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577700:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577705:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577710:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577715:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577719:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577724:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577728:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577733:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577738:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577743:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577749:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577754:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577759:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577764:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577769:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577774:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577778:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577815:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.577826:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.578906:0:6686:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff93ef0707f000:6686] 0 exiting: rc = 1 00000100:00100000:3.0:1788813227.585302:0:6687:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff93ef10834c00:6687] 1 exiting: rc = 0 00000100:00100000:0.0:1788813227.586094:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586103:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586123:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586129:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586135:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586140:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586145:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586150:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586157:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586174:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586180:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586186:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586191:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586197:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586221:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586228:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586234:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586240:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586245:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586250:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586255:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586261:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586267:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586272:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586278:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586284:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586303:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586310:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586316:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586321:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586327:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586331:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586336:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586341:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586346:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586352:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586357:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586370:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586389:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586398:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586403:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586408:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586414:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586419:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586424:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586431:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586448:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586455:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586461:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586468:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586489:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586496:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586504:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.586509:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.587009:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.587019:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.587026:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.587032:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.587037:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.587043:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.587049:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.587055:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.587061:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813227.587095:0:13265:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788813227.604451:0:13265:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788813244.994523:0:13880:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788813253.362735:0:14341:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788813253.362740:0:14341:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788813253.362959:0:14341:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93ef36653800 00000020:01000004:2.0:1788813253.362972:0:14341:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788813253.362980:0:14341:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788813253.362994:0:14341:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff93ef355c99c0) 00000020:00000080:2.0:1788813253.363006:0:14341:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788813253.375417:0:14341:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788813253.377627:0:14341:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1788813253.378016:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1788813253.378117:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:3.0:1788813253.378216:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:3.0:1788813253.378315:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1788813253.378497:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1788813253.378675:0:14341:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788813253.378749:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:3.0:1788813253.380825:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:3.0:1788813253.382952:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 255: rc = 0 00100000:10000000:3.0:1788813253.383055:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 255: rc = 0 00100000:10000000:3.0:1788813253.383972:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 643: rc = 0 00100000:10000000:3.0:1788813253.384220:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 643: rc = 0 00100000:10000000:3.0:1788813253.384470:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 643: rc = 0 00100000:10000000:3.0:1788813253.384704:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 643: rc = 0 00100000:10000000:3.0:1788813253.385150:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 643: rc = 0 00100000:10000000:3.0:1788813253.385527:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 643: rc = 0 00100000:10000000:3.0:1788813253.385776:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 643: rc = 0 00100000:10000000:3.0:1788813253.386130:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 643: rc = 0 00100000:10000000:3.0:1788813253.386457:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 643: rc = 0 00100000:10000000:3.0:1788813253.386706:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 643: rc = 0 00100000:10000000:2.0:1788813253.387205:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 643: rc = 0 00100000:10000000:2.0:1788813253.387534:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 643: rc = 0 00100000:10000000:2.0:1788813253.388117:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 315: rc = 0 00100000:10000000:2.0:1788813253.388445:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 315: rc = 0 00100000:10000000:2.0:1788813253.388692:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 315: rc = 0 00100000:10000000:2.0:1788813253.389044:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 315: rc = 0 00100000:10000000:2.0:1788813253.389458:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 315: rc = 0 00100000:10000000:2.0:1788813253.389713:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 315: rc = 0 00100000:10000000:2.0:1788813253.390054:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 315: rc = 0 00100000:10000000:2.0:1788813253.390296:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 315: rc = 0 00100000:10000000:2.0:1788813253.390661:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 315: rc = 0 00100000:10000000:2.0:1788813253.390952:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 315: rc = 0 00100000:10000000:2.0:1788813253.391189:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 315: rc = 0 00100000:10000000:2.0:1788813253.391507:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 315: rc = 0 00100000:10000000:2.0:1788813253.391752:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 315: rc = 0 00100000:10000000:2.0:1788813253.393303:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 315: rc = 0 00100000:10000000:2.0:1788813253.393635:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 315: rc = 0 00100000:10000000:2.0:1788813253.393987:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 315: rc = 0 00100000:10000000:2.0:1788813253.394927:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 315: rc = 0 00100000:10000000:2.0:1788813253.395198:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 315: rc = 0 00100000:10000000:2.0:1788813253.395642:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 315: rc = 0 00100000:10000000:2.0:1788813253.395974:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 315: rc = 0 00100000:10000000:2.0:1788813253.396385:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 315: rc = 0 00100000:10000000:2.0:1788813253.396635:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 315: rc = 0 00100000:10000000:2.0:1788813253.396937:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 315: rc = 0 00100000:10000000:2.0:1788813253.397177:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 315: rc = 0 00100000:10000000:2.0:1788813253.397444:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 315: rc = 0 00100000:10000000:2.0:1788813253.397689:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 315: rc = 0 00100000:10000000:2.0:1788813253.397980:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 315: rc = 0 00100000:10000000:2.0:1788813253.398221:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 315: rc = 0 00100000:10000000:2.0:1788813253.398468:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 315: rc = 0 00100000:10000000:2.0:1788813253.398714:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 315: rc = 0 00100000:10000000:2.0:1788813253.399112:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 315: rc = 0 00100000:10000000:2.0:1788813253.399361:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 315: rc = 0 00100000:10000000:2.0:1788813253.399712:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 569: rc = 0 00100000:10000000:2.0:1788813253.400377:0:14341:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788813253.400534:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 768: rc = 0 00100000:10000000:2.0:1788813253.400730:0:14341:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788813253.400887:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 768: rc = 0 00100000:10000000:2.0:1788813253.401076:0:14341:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788813253.401146:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 768: rc = 0 00100000:10000000:2.0:1788813253.401486:0:14341:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788813253.401554:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 302: rc = 0 00100000:10000000:2.0:1788813253.401736:0:14341:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788813253.401837:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 302: rc = 0 00100000:10000000:2.0:1788813253.402032:0:14341:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788813253.402100:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 302: rc = 0 00000020:00000080:2.0:1788813253.402354:0:14341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788813253.402361:0:14341:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788813253.402371:0:14341:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b294f297b1ed1d7 00000020:01000004:2.0:1788813253.402378:0:14341:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788813253.402383:0:14341:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788813253.402387:0:14341:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93ef36653800 from MGS 00000020:01000004:2.0:1788813253.402391:0:14341:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788813253.402400:0:14341:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff93ef355c8000) 00000020:00000080:2.0:1788813253.402409:0:14341:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788813253.402455:0:14341:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93ef36653800 from MGS, refs=2 00080000:01000000:2.0:1788813253.402460:0:14341:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788813253.402467:0:14341:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b294f297b1ed1e5 00000100:00100000:2.0:1788813253.402557:0:14341:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788813253.402681:0:14341:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788813253.402688:0:14341:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788813253.403228:0:14341:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788813253.403234:0:14341:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788813253.403762:0:14341:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788813253.404076:0:14341:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788813253.404081:0:14341:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788813253.404469:0:14341:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788813253.404475:0:14341:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788813253.408481:0:14341:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788813253.408494:0:14341:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788813253.409104:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813253.409107:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813253.409109:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813253.409359:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813253.409362:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813253.409364:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813253.409905:0:14341:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788813253.413900:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788813253.421525:0:14341:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788813253.421543:0:14341:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788813253.421546:0:14341:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788813253.427975:0:14350:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788813253.428210:0:14341:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788813253.428326:0:14341:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788813253.428884:0:14341:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788813253.429189:0:14341:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788813253.429393:0:14341:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788813253.429399:0:14341:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788813253.430131:0:14341:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788813253.430139:0:14341:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788813253.432095:0:14341:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788813253.432105:0:14341:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788813253.432698:0:14341:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788813253.432717:0:14341:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.113@tcp' 00000020:01000004:0.0:1788813253.432719:0:14341:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788813253.432747:0:14341:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.113@tcp (typ=mgc) 00000020:00000080:0.0:1788813253.432758:0:14341:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.113@tcp (ffff93ef12003380) 00000020:00000080:0.0:1788813253.432772:0:14341:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788813253.432883:0:14341:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93ef213c6000@MGC192.168.203.113@tcp: add connection 192.168.203.113@tcp at head 00010000:00010000:0.0:1788813253.433065:0:14341:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.113@tcp-0 is initialized 00000040:01000000:0.0:1788813253.433071:0:14341:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788813253.437109:0:14357:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788813253.437153:0:14341:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.113@tcp (uuid 7b6c640d-d182-4e60-bd96-35e8ac0c3a57) 00000020:00000080:3.0:1788813253.437173:0:14341:0:(genops.c:1384:class_connect()) connect: client 7b6c640d-d182-4e60-bd96-35e8ac0c3a57, cookie 0x1b294f297b1ed1f3 00000100:00080000:3.0:1788813253.437183:0:14341:0:(import.c:545:import_select_connection()) MGC192.168.203.113@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788813253.437194:0:14341:0:(import.c:666:import_select_connection()) MGC192.168.203.113@tcp: import ffff93ef213c6000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788813253.437226:0:14341:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ef3ae7b800 x1875706322699264/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788813253.437255:0:14341:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7b6c640d-d182-4e60-bd96-35e8ac0c3a57->MGS 00000020:01000004:3.0:1788813253.437279:0:14341:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788813253.437284:0:14341:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788813253.437296:0:14341:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff93ef3591cd40) 00000020:00000080:3.0:1788813253.437307:0:14341:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788813253.439219:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3298:1875706322699264:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788813253.439292:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788813253.439377:0:14355:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:0.0:1788813253.442990:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322699264 00000100:00100000:0.0:1788813253.443004:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322699264 00000100:00100000:0.0:1788813253.443047:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813253.443055:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ba9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3298:x1875706322699264:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788813253.443081:0:14352:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 7b6c640d-d182-4e60-bd96-35e8ac0c3a57@0@lo t0 exp 0000000000000000 cur 413 last 0 00000020:00000080:0.0:1788813253.443110:0:14352:0:(genops.c:1384:class_connect()) connect: client 7b6c640d-d182-4e60-bd96-35e8ac0c3a57, cookie 0x1b294f297b1ed201 00000100:00080000:0.0:1788813253.443240:0:14352:0:(import.c:65:import_set_state_nolock()) ffff93ef213c7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788813253.443320:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ba9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+5:3298:x1875706322699264:12345-0@lo:250:mount.lustre.0 Request processed in 265us (4027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813253.443328:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813253.445303:0:3298:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.113@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788813253.445317:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.113@tcp: connect to target with instance 0 00000100:00080000:0.0:1788813253.445325:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.113@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788813253.445330:0:3298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788813253.445342:0:3298:0:(import.c:65:import_set_state_nolock()) ffff93ef213c6000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788813253.445346:0:3298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788813253.445362:0:3298:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788813253.445369:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3298:1875706322699264:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788813253.452210:0:14341:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813253.452628:0:14341:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788813253.452634:0:14341:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788813253.453451:0:14341:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788813253.453459:0:14341:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788813253.453808:0:14341:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788813253.453815:0:14341:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788813253.454478:0:14341:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813253.454657:0:14341:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788813253.454663:0:14341:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788813253.455545:0:14341:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788813253.455554:0:14341:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788813253.487432:0:14341:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813253.487699:0:14341:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788813253.487707:0:14341:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788813253.489991:0:14341:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788813253.490006:0:14341:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788813253.490494:0:14341:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813253.490662:0:14341:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788813253.490666:0:14341:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788813253.491204:0:14341:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788813253.491211:0:14341:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788813253.491636:0:14341:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813253.491763:0:14341:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788813253.491768:0:14341:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788813253.492484:0:14341:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788813253.492492:0:14341:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788813253.493134:0:14341:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813253.493293:0:14341:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788813253.493298:0:14341:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788813253.493688:0:14341:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788813253.493696:0:14341:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788813253.510769:0:14341:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788813253.511233:0:14341:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788813253.511241:0:14341:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788813253.512413:0:14341:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788813253.512423:0:14341:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788813253.513250:0:14341:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788813253.513259:0:14341:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788813253.514011:0:14341:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788813253.514034:0:14341:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788813253.514041:0:14341:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788813253.514166:0:14341:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788813253.514196:0:14341:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.113@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788813253.514200:0:14341:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788813253.514202:0:14341:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788813253.514203:0:14341:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813253.514204:0:14341:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813253.514206:0:14341:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813253.514207:0:14341:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813253.514208:0:14341:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788813253.514209:0:14341:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788813253.514211:0:14341:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813253.514212:0:14341:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788813253.514214:0:14341:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788813253.514216:0:14341:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788813253.514217:0:14341:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788813253.514219:0:14341:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813253.514219:0:14341:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813253.514220:0:14341:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813253.514221:0:14341:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813253.514222:0:14341:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788813253.514223:0:14341:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788813253.514224:0:14341:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813253.514225:0:14341:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788813253.514250:0:14341:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788813253.514270:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322699392:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788813253.514335:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813253.514423:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1caf3540 going to sleep for 11 seconds 00000100:00100000:2.0:1788813253.514467:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322699392 00000100:00100000:2.0:1788813253.514475:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322699392 00000100:00100000:2.0:1788813253.514546:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813253.514557:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ba8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+5:14341:x1875706322699392:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788813253.514602:0:14354:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788813253.514605:0:14354:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788813253.514609:0:14354:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788813253.514922:0:14375:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788813253.515267:0:14354:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1788813253.516290:0:14376:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788813253.516296:0:14376:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788813253.516299:0:14376:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788813253.516331:0:14376:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788813253.516592:0:14354:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788813253.516600:0:14354:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788813253.521071:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ba8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+5:14341:x1875706322699392:12345-0@lo:253:mount.lustre.0 Request processed in 6507us (6728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813253.521103:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788813253.521194:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322699392:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788813253.521208:0:14341:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788813253.521211:0:14341:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788813253.521213:0:14341:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788813253.521214:0:14341:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788813253.521216:0:14341:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788813253.521217:0:14341:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788813253.521218:0:14341:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788813253.521219:0:14341:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788813253.521221:0:14341:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788813253.521222:0:14341:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788813253.521223:0:14341:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788813253.521240:0:14341:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93ef36653800 from lustre-MDT0000 10000000:01000000:0.0:1788813253.521264:0:14341:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788813253.521266:0:14341:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788813253.521270:0:14341:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93ef12003380 10000000:01000000:0.0:1788813253.521274:0:14341:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788813253.521283:0:14341:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93ef12003380 from 1 10000000:01000000:0.0:1788813253.521286:0:14341:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788813253.521319:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef190ce000/0x1b294f297b1ed208 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813253.521329:0:14341:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef190ce000/0x1b294f297b1ed208 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813253.521361:0:14341:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef190ce000/0x1b294f297b1ed208 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813253.521380:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ecb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322699520:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788813253.521416:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813253.521492:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef212380c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813253.521629:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322699520 00000100:00100000:1.0:1788813253.521637:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322699520 00000100:00100000:1.0:1788813253.521706:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813253.521714:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36baa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+5:14341:x1875706322699520:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813253.521726:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813253.521740:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef354fc200/0x1b294f297b1ed20f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ed208 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813253.521769:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef354fc200/0x1b294f297b1ed20f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ed208 expref: 6 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813253.521806:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef354fc200/0x1b294f297b1ed20f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed208 expref: 6 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813253.521815:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fc200, rc 0) 00000100:00100000:1.0:1788813253.521852:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36baa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+6:14341:x1875706322699520:12345-0@lo:101:mount.lustre.0 Request processed in 139us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813253.521860:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788813253.521938:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ecb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322699520:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813253.521950:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef190ce000/0x1b294f297b1ed208 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed20f expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813253.521959:0:14341:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef190ce000/0x1b294f297b1ed208 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ed20f expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813253.522007:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322699648:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813253.522033:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813253.522248:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1caf3780 going to sleep for 11 seconds 00000100:00100000:0.0:1788813253.522306:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322699648 00000100:00100000:0.0:1788813253.522311:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322699648 00000100:00100000:0.0:1788813253.522331:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788813253.522348:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36bab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+6:14341:x1875706322699648:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813253.522550:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36bab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+6:14341:x1875706322699648:12345-0@lo:501:mount.lustre.0 Request processed in 202us (516us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788813253.522557:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788813253.522673:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322699648:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788813253.522698:0:14341:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788813253.522711:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef190ce000/0x1b294f297b1ed208 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed20f expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813253.522719:0:14341:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef190ce000/0x1b294f297b1ed208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed20f expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813253.522726:0:14341:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93ef36653800 10000000:01000000:3.0:1788813253.522731:0:14341:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788813253.522735:0:14341:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93ef36653800 10000000:01000000:3.0:1788813253.522737:0:14341:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788813253.522740:0:14341:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93ef36653800 from 1 10000000:01000000:3.0:1788813253.522742:0:14341:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788813253.522761:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef01517800/0x1b294f297b1ed216 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813253.522812:0:14341:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef01517800/0x1b294f297b1ed216 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813253.522823:0:14341:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef01517800/0x1b294f297b1ed216 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813253.522836:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322699776:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788813253.522862:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813253.522877:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1caf3780 going to sleep for 11 seconds 00000100:00100000:0.0:1788813253.522959:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322699776 00000100:00100000:0.0:1788813253.522964:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322699776 00000100:00100000:0.0:1788813253.522980:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788813253.522986:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ba8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+6:14341:x1875706322699776:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813253.522993:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813253.523003:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef190ce800/0x1b294f297b1ed21d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ed216 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813253.523017:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef190ce800/0x1b294f297b1ed21d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ed216 expref: 7 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813253.523024:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef190ce800/0x1b294f297b1ed21d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed216 expref: 7 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813253.523039:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190ce800, rc 0) 00000100:00100000:0.0:1788813253.523065:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ba8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+7:14341:x1875706322699776:12345-0@lo:101:mount.lustre.0 Request processed in 79us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813253.523071:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788813253.523137:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322699776:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813253.523147:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef01517800/0x1b294f297b1ed216 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed21d expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813253.523155:0:14341:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef01517800/0x1b294f297b1ed216 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ed21d expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813253.523166:0:14341:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788813253.523169:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef01517800/0x1b294f297b1ed216 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed21d expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813253.523175:0:14341:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef01517800/0x1b294f297b1ed216 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed21d expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813253.523180:0:14341:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788813253.523183:0:14341:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788813253.523188:0:14341:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93ef36653800 10000000:01000000:3.0:1788813253.523190:0:14341:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788813253.523198:0:14341:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788813253.523201:0:14341:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788813253.523215:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef01517400/0x1b294f297b1ed224 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813253.523221:0:14341:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef01517400/0x1b294f297b1ed224 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813253.523228:0:14341:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef01517400/0x1b294f297b1ed224 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813253.523240:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322699904:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788813253.523264:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813253.523287:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1caf3780 going to sleep for 11 seconds 00000100:00100000:0.0:1788813253.523397:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322699904 00000100:00100000:0.0:1788813253.523401:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322699904 00000100:00100000:0.0:1788813253.523417:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788813253.523422:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36960850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+7:14341:x1875706322699904:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813253.523429:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813253.523435:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef190cea00/0x1b294f297b1ed22b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ed224 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813253.523448:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef190cea00/0x1b294f297b1ed22b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ed224 expref: 8 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813253.523455:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef190cea00/0x1b294f297b1ed22b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed224 expref: 8 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813253.523460:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cea00, rc 0) 00000100:00100000:0.0:1788813253.523491:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36960850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+8:14341:x1875706322699904:12345-0@lo:101:mount.lustre.0 Request processed in 69us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813253.523498:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788813253.523598:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322699904:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813253.523609:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef01517400/0x1b294f297b1ed224 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed22b expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813253.523615:0:14341:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef01517400/0x1b294f297b1ed224 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ed22b expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813253.523653:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322700032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813253.523676:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813253.523695:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1caf3780 going to sleep for 11 seconds 00000100:00100000:1.0:1788813253.523752:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322700032 00000100:00100000:1.0:1788813253.523756:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322700032 00000100:00100000:1.0:1788813253.523776:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788813253.523795:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36963050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+8:14341:x1875706322700032:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813253.524120:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36963050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+9:14341:x1875706322700032:12345-0@lo:501:mount.lustre.0 Request processed in 337us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813253.524127:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788813253.524208:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322700032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813253.524235:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322700160:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788813253.524272:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813253.524307:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1caf3780 going to sleep for 11 seconds 00000100:00100000:1.0:1788813253.524364:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322700160 00000100:00100000:1.0:1788813253.524369:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322700160 00000100:00100000:1.0:1788813253.524387:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788813253.524393:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36960050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+9:14341:x1875706322700160:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788813253.524717:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36960050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+9:14341:x1875706322700160:12345-0@lo:503:mount.lustre.0 Request processed in 322us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813253.524724:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788813253.525026:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322700160:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813253.525444:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14377:1875706322700288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813253.525488:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813253.525554:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef21238000 going to sleep for 11 seconds 00000100:00100000:1.0:1788813253.525588:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322700288 00000100:00100000:1.0:1788813253.525593:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322700288 00000100:00100000:1.0:1788813253.525663:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788813253.525670:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36962850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+9:14377:x1875706322700288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813253.525964:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36962850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+9:14377:x1875706322700288:12345-0@lo:502:llog_process_th.0 Request processed in 295us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813253.525971:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788813253.526067:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14377:1875706322700288:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788813253.526091:0:14377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813253.526101:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813253.526108:0:14377:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788813253.526114:0:14377:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788813253.526117:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788813253.526129:0:14377:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff93ef355cb380) 00000020:00000080:2.0:1788813253.526144:0:14377:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788813253.526150:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788813253.526206:0:14377:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788813253.526212:0:14377:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b294f297b1ed239 00000020:00000080:2.0:1788813253.526477:0:14377:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788813253.526482:0:14377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813253.526486:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813253.526487:0:14377:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788813253.526490:0:14377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813253.526493:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813253.526495:0:14377:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788813253.526497:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788813253.526505:0:14377:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff93ef355ccd40) 00000020:00000080:2.0:1788813253.526513:0:14377:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788813253.526517:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788813253.526519:0:14377:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788813253.526522:0:14377:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788813253.526527:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788813253.526582:0:14377:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93ef36653800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788813253.526595:0:14377:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff93ef370c19c0) 00000020:00000080:2.0:1788813253.526603:0:14377:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788813253.526643:0:14377:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788813253.526650:0:14377:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b294f297b1ed24e 00000020:00000080:2.0:1788813253.526740:0:14377:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788813253.526746:0:14377:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788813253.526750:0:14377:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1b294f297b1ed255 00080000:01000000:2.0:1788813253.526754:0:14377:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788813253.526758:0:14377:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b294f297b1ed25c 00010000:00010000:2.0:1788813253.574907:0:14377:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788813253.575397:0:14377:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1788813253.575586:0:14377:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788813253.576218:0:14377:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff93ef370c3380) 00000020:00000080:2.0:1788813253.576237:0:14377:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788813253.576301:0:14377:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788813253.576308:0:14377:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b294f297b1ed26a 00000020:00000080:3.0:1788813253.576776:0:14377:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788813253.581638:0:14377:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1b294f297b1ed271 00000020:00000080:2.0:1788813253.582826:0:14377:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788813253.582839:0:14377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813253.582847:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813253.582849:0:14377:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788813253.582852:0:14377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788813253.582855:0:14377:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1788813253.582857:0:14377:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788813253.582858:0:14377:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788813253.582860:0:14377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788813253.582863:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813253.582864:0:14377:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788813253.582866:0:14377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813253.582872:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813253.582873:0:14377:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788813253.582877:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788813253.582926:0:14377:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788813253.582942:0:14377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813253.582946:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813253.582948:0:14377:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788813253.582950:0:14377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788813253.582954:0:14377:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788813253.582957:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813253.582958:0:14377:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788813253.582962:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788813253.582968:0:14377:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:2.0:1788813253.582993:0:14377:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788813253.582996:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788813253.583016:0:14377:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93ef370c4d40) 00000020:00000080:2.0:1788813253.583030:0:14377:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788813253.583037:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788813253.583090:0:14377:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788813253.583095:0:14377:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788813253.583101:0:14377:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b294f297b1ed27f 00010000:00080000:2.0:1788813253.583132:0:14377:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93ee06e9a000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1788813253.583378:0:14377:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788813253.583747:0:14377:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788813253.583818:0:14377:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788813253.585108:0:14377:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788813253.585169:0:14377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788813253.585251:0:14377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788813253.585854:0:14381:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788813253.585860:0:14381:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788813253.592102:0:14377:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788813253.592119:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788813253.592163:0:14377:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788813253.592187:0:14377:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b294f297b1ed286 00000100:00080000:1.0:1788813253.592197:0:14377:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788813253.592209:0:14377:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93ee06e9a000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1788813253.592251:0:14377:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ef37fb4380 x1875706322700416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788813253.592317:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1875706322700416:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788813253.592450:0:3298:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706322700416 offset 0 length 520: 4 00000100:00080000:1.0:1788813253.592513:0:14377:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788813253.592578:0:14377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813253.592583:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813253.592585:0:14377:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788813253.592588:0:14377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788813253.592590:0:14377:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1788813253.592592:0:14377:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788813253.592594:0:14377:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788813253.592595:0:14377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788813253.592598:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813253.592599:0:14377:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788813253.592602:0:14377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788813253.592606:0:14377:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788813253.592609:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813253.592611:0:14377:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788813253.592622:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788813253.592625:0:14377:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:1.0:1788813253.592646:0:14377:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788813253.592649:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788813253.592660:0:14377:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93ef119e0000) 00000020:00000080:1.0:1788813253.592672:0:14377:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788813253.592677:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788813253.592733:0:14377:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788813253.592740:0:14377:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788813253.592746:0:14377:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1b294f297b1ed294 00010000:00080000:1.0:1788813253.592773:0:14377:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93ef3ad93000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1788813253.593045:0:14377:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788813253.593232:0:14377:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788813253.593255:0:14377:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788813253.593960:0:14377:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788813253.594025:0:14377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788813253.594094:0:14377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788813253.594660:0:14383:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788813253.594665:0:14383:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788813253.595458:0:14377:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788813253.595470:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788813253.595503:0:14377:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788813253.595523:0:14377:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b294f297b1ed29b 00000100:00080000:2.0:1788813253.595532:0:14377:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788813253.595542:0:14377:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93ef3ad93000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788813253.595575:0:14377:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ef36161180 x1875706322700544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788813253.595641:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36161180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1875706322700544:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788813253.595693:0:3298:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706322700544 offset 0 length 520: 4 00000100:00080000:2.0:1788813253.595742:0:14377:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788813253.595870:0:14377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813253.595875:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813253.595877:0:14377:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788813253.595880:0:14377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813253.595884:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813253.595885:0:14377:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788813253.595898:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788813253.595900:0:14377:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788813253.595903:0:14377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813253.595914:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813253.595916:0:14377:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788813253.595919:0:14377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813253.595922:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813253.595923:0:14377:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788813253.595926:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788813253.595955:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36163800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14377:1875706322700672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813253.596006:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813253.596035:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322700672 00000100:00100000:2.0:1788813253.596040:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322700672 00000100:00100000:2.0:1788813253.596076:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788813253.596085:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36961850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+9:14377:x1875706322700672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813253.596300:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36961850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+9:14377:x1875706322700672:12345-0@lo:502:llog_process_th.0 Request processed in 216us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813253.596307:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788813253.596504:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef18dea600 going to sleep for 11 seconds 00000100:00100000:2.0:1788813253.596524:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36163800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14377:1875706322700672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788813253.596548:0:14377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813253.596553:0:14377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813253.596554:0:14377:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788813253.596558:0:14377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788813253.596868:0:14341:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788813253.596885:0:14341:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788813253.596913:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef01517400/0x1b294f297b1ed224 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed22b expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813253.596924:0:14341:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef01517400/0x1b294f297b1ed224 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed22b expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813253.596945:0:14341:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93ef36653800 from 1 10000000:01000000:2.0:1788813253.596948:0:14341:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788813253.596977:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef21618600/0x1b294f297b1ed2a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813253.596985:0:14341:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef21618600/0x1b294f297b1ed2a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813253.596994:0:14341:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef21618600/0x1b294f297b1ed2a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813253.597009:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36163800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322700800:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788813253.597046:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813253.597070:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef076ca480 going to sleep for 11 seconds 00000100:00100000:1.0:1788813253.597129:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322700800 00000100:00100000:1.0:1788813253.597135:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322700800 00000100:00100000:1.0:1788813253.597171:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788813253.597179:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36962050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+9:14341:x1875706322700800:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813253.597190:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813253.597203:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef354fde00/0x1b294f297b1ed2a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ed2a2 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813253.597225:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef354fde00/0x1b294f297b1ed2a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ed2a2 expref: 10 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813253.597238:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef354fde00/0x1b294f297b1ed2a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed2a2 expref: 10 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813253.597255:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fde00, rc 0) 00000100:00100000:1.0:1788813253.597291:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36962050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+10:14341:x1875706322700800:12345-0@lo:101:mount.lustre.0 Request processed in 113us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813253.597297:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788813253.597439:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36163800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322700800:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813253.597451:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef21618600/0x1b294f297b1ed2a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed2a9 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813253.597460:0:14341:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef21618600/0x1b294f297b1ed2a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ed2a9 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813253.598043:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36163800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322700928:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788813253.598084:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813253.598113:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef076ca480 going to sleep for 11 seconds 00000100:00100000:2.0:1788813253.598133:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322700928 00000100:00100000:2.0:1788813253.598139:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322700928 00000100:00100000:2.0:1788813253.598163:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788813253.598214:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36963850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+10:14341:x1875706322700928:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788813253.598230:0:14352:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788813253.598235:0:14352:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788813253.598294:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36963850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+10:14341:x1875706322700928:12345-0@lo:256:mount.lustre.0 Request processed in 82us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813253.598301:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788813253.598475:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36163800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322700928:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788813253.599169:0:14341:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788813253.599235:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef21618600/0x1b294f297b1ed2a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed2a9 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813253.599247:0:14341:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef21618600/0x1b294f297b1ed2a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed2a9 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813253.599255:0:14341:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ef36653800 from 1 10000000:01000000:2.0:1788813253.599258:0:14341:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788813253.599287:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ed2b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813253.599294:0:14341:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ed2b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813253.599304:0:14341:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ed2b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813253.599320:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36163800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322701056:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788813253.599374:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813253.599414:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef076ca480 going to sleep for 11 seconds 00000100:00100000:1.0:1788813253.599547:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322701056 00000100:00100000:1.0:1788813253.599554:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322701056 00000100:00100000:1.0:1788813253.599599:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788813253.599607:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36961050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+10:14341:x1875706322701056:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813253.599618:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813253.599630:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef354fc000/0x1b294f297b1ed2b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ed2b0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813253.599649:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef354fc000/0x1b294f297b1ed2b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ed2b0 expref: 11 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813253.599659:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef354fc000/0x1b294f297b1ed2b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed2b0 expref: 11 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813253.599666:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fc000, rc 0) 00000100:00100000:1.0:1788813253.599699:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36961050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+11:14341:x1875706322701056:12345-0@lo:101:mount.lustre.0 Request processed in 93us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813253.599705:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788813253.600027:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36163800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322701056:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813253.600040:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ed2b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed2b7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813253.600050:0:14341:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ed2b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ed2b7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813253.600097:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36163800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322701184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813253.600120:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813253.600145:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef076ca480 going to sleep for 11 seconds 00000100:00100000:1.0:1788813253.600185:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322701184 00000100:00100000:1.0:1788813253.600189:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322701184 00000100:00100000:1.0:1788813253.600216:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788813253.600222:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36960c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+11:14341:x1875706322701184:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813253.600566:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36960c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+11:14341:x1875706322701184:12345-0@lo:501:mount.lustre.0 Request processed in 343us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813253.600579:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788813253.600726:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36163800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322701184:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813253.600758:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322701312:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788813253.600829:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813253.600847:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1caf39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813253.600919:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322701312 00000100:00100000:2.0:1788813253.600924:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322701312 00000100:00100000:2.0:1788813253.600952:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788813253.600958:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36961450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+11:14341:x1875706322701312:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813253.601090:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36961450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+11:14341:x1875706322701312:12345-0@lo:503:mount.lustre.0 Request processed in 132us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813253.601097:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788813253.601190:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322701312:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788813253.601574:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14385:1875706322701440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813253.601604:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813253.601649:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1caf3240 going to sleep for 11 seconds 00000100:00100000:2.0:1788813253.601674:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322701440 00000100:00100000:2.0:1788813253.601678:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322701440 00000100:00100000:2.0:1788813253.601733:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788813253.601739:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36962450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+11:14385:x1875706322701440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813253.601930:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36962450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+11:14385:x1875706322701440:12345-0@lo:502:llog_process_th.0 Request processed in 190us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813253.601936:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788813253.602011:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14385:1875706322701440:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788813253.602032:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813253.602040:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813253.602042:0:14385:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788813253.602049:0:14385:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93ef36653800 00000020:00000080:3.0:1788813253.602052:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788813253.602058:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813253.602061:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813253.602062:0:14385:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788813253.602064:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813253.602066:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813253.602068:0:14385:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788813253.602070:0:14385:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93ef36653800 00000020:00000080:3.0:1788813253.602072:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788813253.602115:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813253.602122:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813253.602124:0:14385:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788813253.602126:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813253.602129:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813253.602130:0:14385:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788813253.602133:0:14385:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93ef36653800 00000020:00000080:3.0:1788813253.602135:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788813253.602162:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14385:1875706322701568:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813253.602190:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813253.605797:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1caf3240 going to sleep for 11 seconds 00000100:00100000:1.0:1788813253.608939:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322701568 00000100:00100000:1.0:1788813253.608953:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322701568 00000100:00100000:1.0:1788813253.609004:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788813253.609013:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36961c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+11:14385:x1875706322701568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813253.609272:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36961c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+11:14385:x1875706322701568:12345-0@lo:502:llog_process_th.0 Request processed in 259us (7080us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813253.609279:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788813253.611653:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14385:1875706322701568:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788813253.611702:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813253.611711:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813253.611713:0:14385:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788813253.611718:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788813253.611931:0:14341:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788813253.611954:0:14341:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788813253.611982:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ed2b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed2b7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813253.612000:0:14341:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ed2b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed2b7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813253.612044:0:14341:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788813253.612047:0:14341:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93ef36653800 10000000:01000000:2.0:1788813253.612050:0:14341:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93ef36653800 10000000:01000000:2.0:1788813253.612054:0:14341:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788813253.612060:0:14341:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93ef36653800 from 1 10000000:01000000:2.0:1788813253.612062:0:14341:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788813253.612095:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef21619e00/0x1b294f297b1ed2be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813253.612102:0:14341:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef21619e00/0x1b294f297b1ed2be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813253.612112:0:14341:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef21619e00/0x1b294f297b1ed2be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813253.612132:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36162d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322701696:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788813253.612196:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813253.612238:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef0972a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788813253.614474:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322701696 00000100:00100000:1.0:1788813253.614489:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322701696 00000100:00100000:1.0:1788813253.614549:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788813253.614560:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36963c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+11:14341:x1875706322701696:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813253.614577:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813253.614593:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef354fd000/0x1b294f297b1ed2c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ed2be expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813253.614618:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef354fd000/0x1b294f297b1ed2c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ed2be expref: 12 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813253.614629:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef354fd000/0x1b294f297b1ed2c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed2be expref: 12 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813253.614638:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fd000, rc 0) 00000100:00100000:1.0:1788813253.614710:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36963c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+12:14341:x1875706322701696:12345-0@lo:101:mount.lustre.0 Request processed in 153us (2514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813253.614718:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788813253.615936:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36162d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322701696:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813253.615960:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef21619e00/0x1b294f297b1ed2be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed2c5 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813253.615970:0:14341:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef21619e00/0x1b294f297b1ed2be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ed2c5 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813253.616053:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36162d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322701824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813253.616104:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813253.616177:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef0972a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788813253.622880:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322701824 00000100:00100000:0.0:1788813253.622905:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322701824 00000100:00100000:0.0:1788813253.622961:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788813253.622970:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36962c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+12:14341:x1875706322701824:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813253.624463:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36962c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+12:14341:x1875706322701824:12345-0@lo:501:mount.lustre.0 Request processed in 1487us (8351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813253.624476:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788813253.629320:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36162d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322701824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813253.629384:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36162d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322701952:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813253.629448:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813253.629489:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef0972a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788813253.629809:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322701952 00000100:00100000:1.0:1788813253.629822:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322701952 00000100:00100000:1.0:1788813253.629866:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788813253.629873:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36963450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+12:14341:x1875706322701952:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788813253.630045:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36963450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+12:14341:x1875706322701952:12345-0@lo:503:mount.lustre.0 Request processed in 172us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813253.630052:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788813253.630152:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36162d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322701952:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788813253.636509:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14391:1875706322702080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813253.636593:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813253.636672:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1caf3240 going to sleep for 11 seconds 00000100:00100000:0.0:1788813253.636707:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322702080 00000100:00100000:0.0:1788813253.636714:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322702080 00000100:00100000:0.0:1788813253.636819:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788813253.636829:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+12:14391:x1875706322702080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813253.637087:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+12:14391:x1875706322702080:12345-0@lo:502:llog_process_th.0 Request processed in 259us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813253.637095:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788813253.637188:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14391:1875706322702080:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788813253.637243:0:14391:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788813253.637258:0:14391:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff93ef359199c0) 00000020:00000080:3.0:1788813253.637277:0:14391:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788813253.637370:0:14391:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93ef36653800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788813253.637373:0:14391:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93ef36653800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788813253.637376:0:14391:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ef36653800 4 00010000:00080000:3.0:1788813253.637404:0:14391:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93ef194ac800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:3.0:1788813253.639029:0:14391:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788813253.639244:0:14391:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788813253.639290:0:14391:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788813253.639304:0:14391:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1b294f297b1ed2d3 00000100:00080000:3.0:1788813253.639314:0:14391:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788813253.639325:0:14391:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93ef194ac800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788813253.639356:0:14391:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ef3ae7a680 x1875706322702208/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788813253.639405:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875706322702208:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788813253.639466:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788813253.639520:0:14391:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788813253.639541:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813253.639545:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788813253.639547:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813253.639550:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788813253.641599:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae79c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14391:1875706322702336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813253.641669:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813253.642233:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1caf3600 going to sleep for 11 seconds 00000100:00100000:1.0:1788813253.644524:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322702336 00000100:00100000:1.0:1788813253.644540:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322702336 00000100:00100000:1.0:1788813253.644593:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788813253.644604:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+12:14391:x1875706322702336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813253.644920:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+12:14391:x1875706322702336:12345-0@lo:502:llog_process_th.0 Request processed in 318us (3249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813253.644929:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788813253.644984:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322702208 00000100:00100000:1.0:1788813253.644989:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322702208 00000100:00100000:1.0:1788813253.645011:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813253.645015:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1875706322702208:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788813253.645066:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1875706322702208:12345-0@lo:38:llog_process_th.0 Request processed in 49us (5599us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788813253.645072:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813253.645114:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788813253.645122:0:3298:0:(import.c:65:import_set_state_nolock()) ffff93ef194ac800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788813253.645127:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788813253.645130:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875706322702208:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788813253.645231:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae79c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14391:1875706322702336:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788813253.645263:0:14391:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788813253.645861:0:14341:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788813253.645883:0:14341:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788813253.645912:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef21619e00/0x1b294f297b1ed2be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed2c5 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813253.645924:0:14341:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef21619e00/0x1b294f297b1ed2be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed2c5 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788813253.645973:0:14341:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788813253.645979:0:14341:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788813253.645980:0:14341:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788813253.645982:0:14341:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788813253.645983:0:14341:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788813253.645984:0:14341:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788813253.645985:0:14341:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788813253.645986:0:14341:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788813253.645988:0:14341:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788813253.645989:0:14341:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788813253.645993:0:14341:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788813253.645995:0:14341:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788813253.645996:0:14341:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788813253.645997:0:14341:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788813253.645998:0:14341:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788813253.645999:0:14341:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788813253.646000:0:14341:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788813253.646001:0:14341:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788813253.646002:0:14341:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788813253.646003:0:14341:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788813253.646004:0:14341:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788813253.646025:0:14341:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788813253.646043:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322702464:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788813253.646094:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813253.646125:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef12685c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813253.646254:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322702464 00000100:00100000:1.0:1788813253.646259:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322702464 00000100:00100000:1.0:1788813253.646298:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788813253.646312:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+12:14341:x1875706322702464:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788813253.646431:0:14352:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788813253.646445:0:14352:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788813253.682960:0:14352:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788813253.682981:0:14352:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788813253.683046:0:14375:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788813253.683051:0:14375:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788813253.683078:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ed2da lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813253.683097:0:14375:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef354fde00/0x1b294f297b1ed2a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed2a2 expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813253.683106:0:14375:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ed2da lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813253.683144:0:14375:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef354fde00/0x1b294f297b1ed2a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ed2a2 expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813253.683159:0:14375:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ef354fde00/0x1b294f297b1ed2a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ed2a2 expref: 12 pid: 14353 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813253.683173:0:14375:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36162d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14375:1875706322702592:0@lo:104: 00000100:00100000:2.0:1788813253.683254:0:14375:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813253.683299:0:14375:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef0972acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813253.683544:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322702592 00000100:00100000:1.0:1788813253.683553:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322702592 00000100:00100000:1.0:1788813253.684007:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813253.684017:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36162680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+3:14375:x1875706322702592:12345-0@lo:104: 00010000:00010000:1.0:1788813253.684029:0:14342:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef21618600/0x1b294f297b1ed2a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ed2a9 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813253.684089:0:14342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788813253.684097:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36162680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+3:14375:x1875706322702592:12345-0@lo:104: Request processed in 82us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813253.684104:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788813253.684175:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813253.684182:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef21618600/0x1b294f297b1ed2a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ed2a9 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813253.684189:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618600 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:0.0:1788813253.684193:0:14348:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef21618600/0x1b294f297b1ed2a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ed2a9 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813253.684201:0:14348:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef21618600/0x1b294f297b1ed2a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ed2a9 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813253.684209:0:14348:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef21618600/0x1b294f297b1ed2a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ed2a9 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813253.684223:0:14348:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788813253.684254:0:14348:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef21618600/0x1b294f297b1ed2a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ed2a9 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813253.684261:0:14348:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813253.684279:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef21618600/0x1b294f297b1ed2a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ed2a9 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813253.684286:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef21618600/0x1b294f297b1ed2a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ed2a9 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813253.684302:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813253.684304:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813253.684305:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813253.684344:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3301:1875706322702720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813253.684377:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813253.684437:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322702720 00000100:00100000:0.0:1788813253.684442:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322702720 00010000:00010000:0.0:1788813253.684460:0:14344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef354fde00/0x1b294f297b1ed2a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ed2a2 expref: 13 pid: 14353 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813253.684480:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813253.684486:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+13:3301:x1875706322702720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813253.684496:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813253.684501:0:14344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef354fde00/0x1b294f297b1ed2a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ed2a2 expref: 13 pid: 14353 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813253.684510:0:14344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef354fde00/0x1b294f297b1ed2a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ed2a2 expref: 13 pid: 14353 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813253.684533:0:14344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ed2da lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813253.684540:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ed2da lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788813253.684555:0:14344:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001504223s 00010000:00010000:0.0:1788813253.684559:0:14344:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ed2da lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813253.684567:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ed2da lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813253.684574:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ed2da lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813253.684580:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ed2da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813253.684586:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618a00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813253.684590:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ed2da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813253.684596:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ed2da lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813253.684605:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ed2da lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813253.684615:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813253.684644:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+13:3301:x1875706322702720:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813253.684657:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813253.684712:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3301:1875706322702720:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813253.687659:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef354fde00/0x1b294f297b1ed2a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ed2a2 expref: 12 pid: 14353 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813253.687680:0:14375:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36162d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14375:1875706322702592:0@lo:104: 00010000:00010000:1.0:1788813253.687702:0:14375:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ed2da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813253.687711:0:14375:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ed2da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813253.687717:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ed2da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813253.687723:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ed2da lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813253.690366:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+11:14341:x1875706322702464:12345-0@lo:253:mount.lustre.0 Request processed in 44045us (44262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813253.690380:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788813253.690504:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14341:1875706322702464:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788813253.690520:0:14341:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788813253.690523:0:14341:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788813253.690525:0:14341:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788813253.690526:0:14341:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788813253.690528:0:14341:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788813253.690529:0:14341:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788813253.690530:0:14341:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788813253.690531:0:14341:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788813253.690533:0:14341:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788813253.690535:0:14341:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788813253.690536:0:14341:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788813253.690554:0:14341:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788813253.701653:0:14341:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788813253.701950:0:14341:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788813253.702228:0:14341:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788813253.702463:0:14341:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788813253.702728:0:14341:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788813253.703032:0:14341:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788813253.703763:0:14341:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788813253.704104:0:14341:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788813253.704434:0:14341:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788813253.704655:0:14341:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788813253.704959:0:14341:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788813253.705113:0:14341:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1788813253.724729:0:14341:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788813253.725234:0:14341:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788813253.725491:0:14397:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788813253.725495:0:14397:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788813253.725585:0:14398:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788813253.725653:0:14398:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788813253.727619:0:14398:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788813253.727698:0:14398:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788813253.727702:0:14398:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1788813253.729579:0:14341:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788813253.729704:0:14341:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788813253.731797:0:14341:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788813253.731817:0:14341:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788813253.732081:0:14341:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788813253.733550:0:14341:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788813253.734207:0:14341:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788813253.734240:0:14341:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788813253.734739:0:14341:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:1.0:1788813253.735636:0:14341:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1788813253.740673:0:14341:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788813253.771841:0:14341:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788813253.771876:0:14341:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa9e5c1907988 00100000:10000000:1.0:1788813253.771883:0:14341:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788813253.772757:0:14341:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788813253.772772:0:14341:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788813253.772820:0:14341:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788813253.772845:0:14341:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788813254.429347:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788813254.687062:0:14390:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813254.687072:0:14390:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813254.687432:0:14390:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788813254.687440:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:0.0:1788813255.260911:0:14357:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788813255.260928:0:14357:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93ef36653800 from 6 10000000:01000000:0.0:1788813255.260933:0:14357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788813255.260981:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef190cee00/0x1b294f297b1ed2e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813255.261012:0:14357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef190cee00/0x1b294f297b1ed2e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813255.261024:0:14357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef190cee00/0x1b294f297b1ed2e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813255.261050:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322702848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788813255.261119:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813255.261197:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee066bb240 going to sleep for 11 seconds 00000100:00100000:2.0:1788813255.261294:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322702848 00000100:00100000:2.0:1788813255.261302:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322702848 00000100:00100000:2.0:1788813255.261365:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788813255.261375:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+11:14357:x1875706322702848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813255.261389:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813255.261404:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef21619000/0x1b294f297b1ed2e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ed2e1 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813255.261427:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef21619000/0x1b294f297b1ed2e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ed2e1 expref: 12 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813255.261438:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef21619000/0x1b294f297b1ed2e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed2e1 expref: 12 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813255.261447:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619000, rc 0) 00000100:00100000:2.0:1788813255.261498:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+12:14357:x1875706322702848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813255.261515:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788813255.261540:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322702848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813255.261558:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef190cee00/0x1b294f297b1ed2e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed2e8 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813255.261568:0:14357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef190cee00/0x1b294f297b1ed2e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ed2e8 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813255.261621:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae79c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322702976:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788813255.261655:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813255.261681:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef118e4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813255.261740:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322702976 00000100:00100000:2.0:1788813255.261744:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322702976 00000100:00100000:2.0:1788813255.261778:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788813255.261916:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+12:14357:x1875706322702976:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788813255.261932:0:14352:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788813255.261948:0:14352:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788813255.261951:0:14352:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788813255.262039:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+12:14357:x1875706322702976:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 173us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813255.262977:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae79c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322702976:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788813255.263037:0:14357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788813255.263045:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef190cee00/0x1b294f297b1ed2e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed2e8 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813255.263056:0:14357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef190cee00/0x1b294f297b1ed2e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed2e8 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813255.274522:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788813255.454472:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788813255.708980:0:14390:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813255.708989:0:14390:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813255.709573:0:14390:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788813255.709635:0:14390:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813255.709660:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:2.0:1788813256.484970:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813257.501156:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813258.526509:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788813258.551539:0:14641:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1788813258.909326:0:1248:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813258.909333:0:1248:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788813258.909336:0:1248:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813258.909339:0:1248:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788813258.909350:0:1248:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788813258.909354:0:1248:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788813258.909358:0:1248:0:(import.c:65:import_set_state_nolock()) ffff93ef194ac800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813258.909374:0:1248:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93ef194ac800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1788813258.909403:0:1248:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ef37fb5c00 x1875706322703232/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788813258.909438:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813258.909444:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875706322703232:0@lo:38:kworker.0 00000100:00100000:1.0:1788813258.909451:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3301:1875706322703104:0@lo:400:kworker.0 00000100:00100000:2.0:1788813258.914605:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813258.915147:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322703232 00000100:00100000:2.0:1788813258.915157:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322703232 00000100:00100000:2.0:1788813258.915207:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813258.915217:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3298:x1875706322703232:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788813258.915245:0:14361:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 419 last 0 00000020:00000080:2.0:1788813258.915291:0:14361:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1b294f297b1ed2ef 00000004:00100000:2.0:1788813258.915308:0:14361:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788813258.915436:0:14361:0:(import.c:65:import_set_state_nolock()) ffff93ef2171b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788813258.915505:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875706322703232:12345-0@lo:38:kworker.0 Request processed in 288us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813258.915523:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813258.915616:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788813258.920280:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93ef37fb5c00 x1875706322703232/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788813258.920303:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788813258.920312:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788813258.920317:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788813258.920320:0:3298:0:(import.c:65:import_set_state_nolock()) ffff93ef194ac800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788813258.920328:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875706322703232:0@lo:38:kworker.0 00000100:00100000:3.0:1788813258.924339:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322703104 00000100:00100000:3.0:1788813258.924357:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322703104 00000100:00100000:3.0:1788813258.924428:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788813258.924441:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+12:3301:x1875706322703104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813258.924532:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+12:3301:x1875706322703104:12345-0@lo:400:kworker.0 Request processed in 94us (8916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813258.924539:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788813258.928311:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3301:1875706322703104:0@lo:400:kworker.0 00010000:00010000:1.0:1788813259.551622:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813260.581147:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813261.596989:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788813261.642378:0:14792:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc5df8440 20000000:00000080:0.0:1788813261.642408:0:14792:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93ef0eb44800 uarg=0000000000000000 20000000:01000000:0.0:1788813261.642457:0:14792:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788813261.642466:0:14792:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788813261.642472:0:14792:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788813261.645161:0:14793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788813261.645554:0:14792:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788813261.666774:0:14792:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788813261.669228:0:14792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ef190ce200/0x1b294f297b1ed2f6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813261.669252:0:14792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef354fc000/0x1b294f297b1ed2b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed2b0 expref: 11 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813261.669510:0:14792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ef190ce200/0x1b294f297b1ed2f6 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813261.670061:0:14792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef354fc000/0x1b294f297b1ed2b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ed2b0 expref: 11 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813261.670085:0:14792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ef354fc000/0x1b294f297b1ed2b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ed2b0 expref: 11 pid: 14354 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813261.670104:0:14792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14792:1875706322703360:0@lo:104: 00000100:00100000:1.0:1788813261.670186:0:14792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813261.670350:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322703360 00000100:00100000:2.0:1788813261.670359:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322703360 00000100:00100000:2.0:1788813261.670436:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813261.670448:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+3:14792:x1875706322703360:12345-0@lo:104: 00010000:00010000:2.0:1788813261.670464:0:14342:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ed2b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ed2b7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813261.670522:0:14342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788813261.670529:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+3:14792:x1875706322703360:12345-0@lo:104: Request processed in 84us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813261.670536:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813261.670648:0:14792:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef18dea9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813261.670678:0:14792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14792:1875706322703360:0@lo:104: 00010000:00010000:1.0:1788813261.670700:0:14792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ef190ce200/0x1b294f297b1ed2f6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.671374:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813261.671385:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ed2b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ed2b7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.671411:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619200 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:3.0:1788813261.671427:0:14347:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ed2b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ed2b7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.671437:0:14347:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ed2b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ed2b7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813261.671444:0:14347:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ed2b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ed2b7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813261.671451:0:14347:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788813261.671500:0:14347:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ed2b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ed2b7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.671507:0:14347:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813261.671540:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ed2b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ed2b7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.671548:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef21619200/0x1b294f297b1ed2b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ed2b7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.671569:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813261.671571:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813261.671573:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813261.671775:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3299:1875706322703488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813261.671889:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813261.672117:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322703488 00000100:00100000:3.0:1788813261.672125:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322703488 00010000:00010000:3.0:1788813261.672156:0:14344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef354fc000/0x1b294f297b1ed2b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ed2b0 expref: 12 pid: 14354 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813261.672189:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788813261.672206:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+12:3299:x1875706322703488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788813261.672221:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813261.672227:0:14344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef354fc000/0x1b294f297b1ed2b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ed2b0 expref: 12 pid: 14354 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.672318:0:14344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef354fc000/0x1b294f297b1ed2b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ed2b0 expref: 12 pid: 14354 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.672335:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef354fc000/0x1b294f297b1ed2b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ed2b0 expref: 12 pid: 14354 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.672353:0:14344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ef190ce200/0x1b294f297b1ed2f6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.672363:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef190ce200/0x1b294f297b1ed2f6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.672381:0:14344:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ef190ce200/0x1b294f297b1ed2f6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.672389:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ef190ce200/0x1b294f297b1ed2f6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.672396:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ef190ce200/0x1b294f297b1ed2f6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.672402:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ef190ce200/0x1b294f297b1ed2f6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.672408:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190ce200 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813261.673368:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ef190ce200/0x1b294f297b1ed2f6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.673403:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ef190ce200/0x1b294f297b1ed2f6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813261.677120:0:14792:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ef190ce200/0x1b294f297b1ed2f6 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813261.677144:0:14792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ef190ce200/0x1b294f297b1ed2f6 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.677804:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ef190ce200/0x1b294f297b1ed2f6 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.677821:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef190ce200/0x1b294f297b1ed2f6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.677855:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813261.678536:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+11:3299:x1875706322703488:12345-0@lo:103:ldlm_bl.0 Request processed in 6323us (6639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813261.678548:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813261.679296:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3299:1875706322703488:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813262.622741:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788813262.752469:0:14357:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788813262.752480:0:14357:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ef36653800 from 10 10000000:01000000:2.0:1788813262.752514:0:14357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788813262.752573:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef21618e00/0x1b294f297b1ed2fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813262.752595:0:14357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef21618e00/0x1b294f297b1ed2fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813262.752609:0:14357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef21618e00/0x1b294f297b1ed2fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813262.752641:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36160380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322703616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788813262.752731:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813262.752802:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef36d8c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788813262.752968:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322703616 00000100:00100000:1.0:1788813262.752979:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322703616 00000100:00100000:1.0:1788813262.753064:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788813262.753076:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+11:14357:x1875706322703616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813262.753094:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813262.753113:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef354fda00/0x1b294f297b1ed304 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ed2fd expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.753144:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef354fda00/0x1b294f297b1ed304 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ed2fd expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.753156:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef354fda00/0x1b294f297b1ed304 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed2fd expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.753167:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fda00, rc 0) 00000100:00100000:1.0:1788813262.753221:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+12:14357:x1875706322703616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813262.753228:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788813262.753312:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36160380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322703616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813262.753329:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef21618e00/0x1b294f297b1ed2fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed304 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.753341:0:14357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef21618e00/0x1b294f297b1ed2fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ed304 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813262.753412:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322703744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813262.753456:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813262.753481:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef249bf000 going to sleep for 11 seconds 00000100:00100000:1.0:1788813262.753495:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322703744 00000100:00100000:1.0:1788813262.753499:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322703744 00000100:00100000:1.0:1788813262.753522:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788813262.753529:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+12:14357:x1875706322703744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813262.753889:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+12:14357:x1875706322703744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 359us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813262.753896:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788813262.753928:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322703744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813262.753958:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322703872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813262.753999:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813262.754017:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef249bf000 going to sleep for 11 seconds 00000100:00100000:1.0:1788813262.754028:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322703872 00000100:00100000:1.0:1788813262.754031:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322703872 00000100:00100000:1.0:1788813262.754051:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788813262.754057:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+12:14357:x1875706322703872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813262.754222:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+12:14357:x1875706322703872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813262.754230:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788813262.754273:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322703872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788813262.754958:0:14830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788813262.755244:0:14357:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788813262.755265:0:14357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788813262.755276:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef21618e00/0x1b294f297b1ed2fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed304 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813262.755289:0:14357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef21618e00/0x1b294f297b1ed2fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed304 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813263.010890:0:3298:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813253/real 1788813253] req@ffff93ef36161180 x1875706322700544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813263 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813263.010926:0:3298:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93ef36161180 x1875706322700544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813263 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813263.010937:0:3298:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813253/real 1788813253] req@ffff93ef37fb4380 x1875706322700416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813263 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813263.010948:0:3298:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93ef37fb4380 x1875706322700416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813263 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788813263.010971:0:3298:0:(import.c:65:import_set_state_nolock()) ffff93ef3ad93000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788813263.010988:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788813263.010993:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36161180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1875706322700544:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788813263.011000:0:3298:0:(import.c:65:import_set_state_nolock()) ffff93ee06e9a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788813263.011006:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788813263.011021:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1875706322700416:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788813263.011057:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813263.011062:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788813263.011066:0:8:0:(import.c:65:import_set_state_nolock()) ffff93ee06e9a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788813263.011072:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 413 00000100:00080000:2.0:1788813263.011079:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788813263.011094:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93ee06e9a000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788813263.011135:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ef36161180 x1875706322704000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788813263.011155:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813263.011159:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788813263.011160:0:8:0:(import.c:65:import_set_state_nolock()) ffff93ef3ad93000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788813263.011164:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 413 00000100:00080000:2.0:1788813263.011167:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788813263.011171:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93ef3ad93000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788813263.011183:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ef36161500 x1875706322704128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813263.011236:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875706322704256:0@lo:400:kworker.0 00000100:00100000:2.0:1788813263.011313:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813263.012267:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36161180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1875706322704000:0@lo:8:kworker.0 00000400:00000100:2.0:1788813263.012308:0:3298:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706322704000 offset 0 length 520: 4 00000100:00100000:2.0:1788813263.012328:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36161500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1875706322704128:0@lo:8:kworker.0 00000400:00000100:2.0:1788813263.012349:0:3298:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706322704128 offset 0 length 520: 4 00000100:00100000:1.0:1788813263.012674:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322704256 00000100:00100000:1.0:1788813263.012685:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322704256 00000100:00100000:1.0:1788813263.012738:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813263.012756:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875706322704256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813263.015600:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875706322704256:12345-0@lo:400:kworker.0 Request processed in 2822us (4262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813263.015618:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788813263.015697:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93ef36162300 x1875706322704256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813263.015716:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875706322704256:0@lo:400:kworker.0 00010000:00010000:3.0:1788813263.645279:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813264.677861:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813265.693104:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788813265.949678:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788813266.718985:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788813267.083197:0:15041:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788813267.083201:0:15041:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788813267.083477:0:15041:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93ef3e0db800 00000020:01000004:0.0:1788813267.083493:0:15041:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788813267.083505:0:15041:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788813267.083518:0:15041:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93ef12004d40) 00000020:00000080:0.0:1788813267.083534:0:15041:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788813267.100901:0:15041:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788813267.101337:0:15041:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788813267.102201:0:15041:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788813267.102503:0:15041:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788813267.102702:0:15041:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788813267.103579:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1788813267.103717:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1788813267.103959:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1788813267.104616:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 358: rc = 0 00100000:10000000:2.0:1788813267.104911:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 358: rc = 0 00100000:10000000:2.0:1788813267.105243:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 358: rc = 0 00100000:10000000:2.0:1788813267.105567:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 358: rc = 0 00100000:10000000:2.0:1788813267.107655:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 358: rc = 0 00100000:10000000:2.0:1788813267.111215:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 358: rc = 0 00000020:00000080:2.0:1788813267.114551:0:15041:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788813267.114566:0:15041:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788813267.114582:0:15041:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1b294f297b1ed312 00000020:01000004:2.0:1788813267.114591:0:15041:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788813267.114611:0:15041:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788813267.114614:0:15041:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788813267.114622:0:15041:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788813267.114626:0:15041:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788813267.114641:0:15041:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93ef370c0000) 00000020:00000080:2.0:1788813267.114653:0:15041:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788813267.120349:0:15041:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788813267.120570:0:15041:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788813267.120576:0:15041:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788813267.121378:0:15041:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788813267.121387:0:15041:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788813267.122156:0:15041:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788813267.122164:0:15041:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788813267.126523:0:15041:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788813267.126698:0:15041:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788813267.126704:0:15041:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788813267.127577:0:15041:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788813267.127586:0:15041:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788813267.155933:0:15041:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813267.156244:0:15041:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788813267.156251:0:15041:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788813267.157714:0:15041:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788813267.157727:0:15041:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788813267.159587:0:15041:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788813267.159599:0:15041:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788813267.164922:0:15041:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813267.165117:0:15041:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788813267.165123:0:15041:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788813267.166657:0:15041:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788813267.166668:0:15041:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788813267.234645:0:15041:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788813267.234869:0:15041:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788813267.234875:0:15041:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788813267.239959:0:15041:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788813267.239977:0:15041:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788813267.240442:0:15041:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788813267.240465:0:15041:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788813267.240471:0:15041:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788813267.258113:0:15041:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788813267.258153:0:15041:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.113@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788813267.258157:0:15041:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788813267.258159:0:15041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788813267.258161:0:15041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813267.258162:0:15041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813267.258163:0:15041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813267.258165:0:15041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813267.258166:0:15041:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788813267.258168:0:15041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813267.258169:0:15041:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788813267.258173:0:15041:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788813267.258175:0:15041:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788813267.258177:0:15041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788813267.258178:0:15041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813267.258179:0:15041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813267.258180:0:15041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813267.258181:0:15041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813267.258182:0:15041:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788813267.258183:0:15041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813267.258184:0:15041:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788813267.258211:0:15041:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788813267.258231:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322704384:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788813267.258311:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813267.258362:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef36d8c240 going to sleep for 11 seconds 00000100:00100000:2.0:1788813267.258462:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322704384 00000100:00100000:2.0:1788813267.258471:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322704384 00000100:00100000:2.0:1788813267.258526:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788813267.258535:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+12:15041:x1875706322704384:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788813267.258564:0:14354:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788813267.258567:0:14354:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788813267.258571:0:14354:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788813267.283159:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+12:15041:x1875706322704384:12345-0@lo:253:mount.lustre.0 Request processed in 24617us (24839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813267.283195:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788813267.292416:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322704384:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788813267.292437:0:15041:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788813267.292440:0:15041:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788813267.292442:0:15041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788813267.292444:0:15041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813267.292460:0:15041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813267.292462:0:15041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813267.292463:0:15041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813267.292465:0:15041:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788813267.292466:0:15041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813267.292468:0:15041:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788813267.292512:0:15041:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93ef3e0db800 from lustre-OST0000 10000000:01000000:3.0:1788813267.292543:0:15041:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788813267.292547:0:15041:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788813267.292554:0:15041:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93ef12003380 local copy 00010000:00010000:3.0:1788813267.292567:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef190ce000/0x1b294f297b1ed208 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed20f expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813267.292991:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322704512:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813267.301206:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813267.301353:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef36d8c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788813267.302224:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322704512 00000100:00100000:2.0:1788813267.302235:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322704512 00000100:00100000:2.0:1788813267.302317:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788813267.302328:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+12:15041:x1875706322704512:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813267.302613:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+12:15041:x1875706322704512:12345-0@lo:501:mount.lustre.0 Request processed in 287us (1414us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788813267.302621:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788813267.302867:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322704512:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788813267.302891:0:15041:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788813267.303080:0:15041:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788813267.303089:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef190ce000/0x1b294f297b1ed208 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed20f expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813267.303100:0:15041:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef190ce000/0x1b294f297b1ed208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed20f expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813267.303304:0:15041:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93ef3e0db800 10000000:01000000:1.0:1788813267.303311:0:15041:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788813267.303321:0:15041:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93ef12003380 10000000:01000000:1.0:1788813267.303324:0:15041:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788813267.303327:0:15041:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff93ef12003380 from 1 10000000:01000000:1.0:1788813267.303330:0:15041:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788813267.303364:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef354fd600/0x1b294f297b1ed320 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813267.303373:0:15041:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef354fd600/0x1b294f297b1ed320 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813267.303383:0:15041:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef354fd600/0x1b294f297b1ed320 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813267.303402:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322704640:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788813267.303519:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813267.303614:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef222aa180 going to sleep for 11 seconds 00000100:00100000:0.0:1788813267.307300:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322704640 00000100:00100000:0.0:1788813267.307315:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322704640 00000100:00100000:0.0:1788813267.307385:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788813267.307396:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+12:15041:x1875706322704640:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813267.307411:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813267.307440:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef190cfc00/0x1b294f297b1ed327 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ed320 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813267.307466:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef190cfc00/0x1b294f297b1ed327 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ed320 expref: 13 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813267.307477:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef190cfc00/0x1b294f297b1ed327 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed320 expref: 13 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813267.307486:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cfc00, rc 0) 00000100:00100000:0.0:1788813267.307555:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+13:15041:x1875706322704640:12345-0@lo:101:mount.lustre.0 Request processed in 161us (4035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813267.307562:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788813267.307845:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322704640:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813267.307866:0:15041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef354fd600/0x1b294f297b1ed320 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed327 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813267.307875:0:15041:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef354fd600/0x1b294f297b1ed320 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ed327 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813267.307896:0:15041:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788813267.307914:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef354fd600/0x1b294f297b1ed320 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed327 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813267.307922:0:15041:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef354fd600/0x1b294f297b1ed320 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed327 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813267.307949:0:15041:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788813267.307953:0:15041:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788813267.307959:0:15041:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788813267.307962:0:15041:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788813267.307985:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef354fc800/0x1b294f297b1ed32e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813267.307993:0:15041:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef354fc800/0x1b294f297b1ed32e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813267.308001:0:15041:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef354fc800/0x1b294f297b1ed32e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813267.308018:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322704768:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788813267.308062:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813267.308098:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef222aa180 going to sleep for 11 seconds 00000100:00100000:2.0:1788813267.308412:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322704768 00000100:00100000:2.0:1788813267.308418:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322704768 00000100:00100000:2.0:1788813267.308463:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788813267.308472:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+13:15041:x1875706322704768:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813267.308482:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813267.308492:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ed335 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ed32e expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813267.308509:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ed335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ed32e expref: 14 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813267.308519:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef21618a00/0x1b294f297b1ed335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed32e expref: 14 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813267.308525:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21618a00, rc 0) 00000100:00100000:2.0:1788813267.308621:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+14:15041:x1875706322704768:12345-0@lo:101:mount.lustre.0 Request processed in 151us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813267.308628:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788813267.312567:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322704768:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813267.312598:0:15041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef354fc800/0x1b294f297b1ed32e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed335 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813267.312611:0:15041:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef354fc800/0x1b294f297b1ed32e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ed335 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788813267.315253:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788813267.316183:0:15041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788813267.316436:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788813267.316477:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788813267.316510:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788813267.316579:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788813267.316615:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788813267.316649:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788813267.316710:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788813267.316718:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788813267.316841:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322704896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813267.316907:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813267.318148:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef12355540 going to sleep for 11 seconds 00000100:00100000:2.0:1788813267.319939:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322704896 00000100:00100000:2.0:1788813267.319952:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322704896 00000100:00100000:2.0:1788813267.320084:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788813267.320096:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+14:15041:x1875706322704896:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813267.322605:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+14:15041:x1875706322704896:12345-0@lo:501:mount.lustre.0 Request processed in 2503us (5690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813267.322632:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788813267.322922:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322704896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813267.322975:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322705024:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788813267.323036:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813267.323078:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef12355540 going to sleep for 11 seconds 00000100:00100000:3.0:1788813267.323196:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322705024 00000100:00100000:3.0:1788813267.323204:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322705024 00000100:00100000:3.0:1788813267.323250:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788813267.323258:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+14:15041:x1875706322705024:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788813267.323599:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+14:15041:x1875706322705024:12345-0@lo:503:mount.lustre.0 Request processed in 341us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813267.323607:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788813267.323720:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322705024:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788813267.324506:0:15041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788813267.324576:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322705152:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813267.324639:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813267.324676:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef20e1f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788813267.325360:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322705152 00000100:00100000:2.0:1788813267.325378:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322705152 00000100:00100000:2.0:1788813267.325428:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788813267.325437:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2101b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+14:15041:x1875706322705152:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813267.325683:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2101b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+14:15041:x1875706322705152:12345-0@lo:502:mount.lustre.0 Request processed in 247us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813267.325691:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788813267.325832:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322705152:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788813267.326250:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788813267.326305:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788813267.326340:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788813267.326453:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788813267.326490:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788813267.326519:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788813267.326562:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788813267.326597:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788813267.326629:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788813267.326690:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788813267.326721:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788813267.326761:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788813267.326856:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322705280:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813267.327715:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813267.327764:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef20e1f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788813267.327898:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322705280 00000100:00100000:3.0:1788813267.327906:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322705280 00000100:00100000:3.0:1788813267.327960:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788813267.327970:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+14:15041:x1875706322705280:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788813267.328190:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+14:15041:x1875706322705280:12345-0@lo:502:mount.lustre.0 Request processed in 222us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813267.328198:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788813267.328384:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322705280:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788813267.328475:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788813267.328489:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788813267.333501:0:15055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788813267.333512:0:15055:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788813267.333532:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813267.333534:0:15055:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788813267.333540:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788813267.333557:0:15055:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93ef35918000) 00000020:00000080:3.0:1788813267.333578:0:15055:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788813267.333584:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788813267.333644:0:15055:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93ef3e0db800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788813267.333652:0:15055:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788813267.333659:0:15055:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1b294f297b1ed343 00010000:00010000:2.0:1788813267.342197:0:15055:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1788813267.342674:0:15055:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1788813267.347552:0:15055:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788813267.356429:0:15055:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788813267.356441:0:15055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813267.356448:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813267.356450:0:15055:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788813267.356454:0:15055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788813267.356457:0:15055:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788813267.356459:0:15055:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788813267.356461:0:15055:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788813267.356462:0:15055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788813267.356476:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813267.356478:0:15055:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788813267.356482:0:15055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813267.356485:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813267.356487:0:15055:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788813267.356490:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788813267.356492:0:15055:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788813267.356494:0:15055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813267.356496:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813267.356497:0:15055:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788813267.356500:0:15055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813267.356502:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813267.356503:0:15055:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788813267.356506:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788813267.356569:0:15055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813267.356573:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813267.356575:0:15055:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788813267.356578:0:15055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788813267.357220:0:15041:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788813267.357249:0:15041:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788813267.357267:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef354fc800/0x1b294f297b1ed32e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed335 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813267.357280:0:15041:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef354fc800/0x1b294f297b1ed32e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed335 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813267.357288:0:15041:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ef3e0db800 from 1 10000000:01000000:3.0:1788813267.357291:0:15041:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788813267.357328:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef01517200/0x1b294f297b1ed34a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813267.357337:0:15041:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef01517200/0x1b294f297b1ed34a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813267.357348:0:15041:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef01517200/0x1b294f297b1ed34a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813267.357371:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322705408:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788813267.357434:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813267.357467:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef36d8c000 going to sleep for 11 seconds 00000100:00100000:3.0:1788813267.359438:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322705408 00000100:00100000:3.0:1788813267.359453:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322705408 00000100:00100000:3.0:1788813267.359512:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788813267.359523:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+14:15041:x1875706322705408:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813267.359539:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813267.359555:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef01516e00/0x1b294f297b1ed351 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ed34a expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813267.359582:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef01516e00/0x1b294f297b1ed351 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ed34a expref: 15 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813267.359593:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef01516e00/0x1b294f297b1ed351 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed34a expref: 15 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813267.359602:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef01516e00, rc 0) 00000100:00100000:3.0:1788813267.359670:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+15:15041:x1875706322705408:12345-0@lo:101:mount.lustre.0 Request processed in 149us (2236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813267.359676:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788813267.359732:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322705408:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813267.359749:0:15041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef01517200/0x1b294f297b1ed34a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed351 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813267.359758:0:15041:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef01517200/0x1b294f297b1ed34a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ed351 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788813267.360622:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788813267.362989:0:15041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788813267.363335:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788813267.363377:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788813267.363443:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788813267.363452:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788813267.363535:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322705536:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813267.363596:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813267.363638:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef36d8c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788813267.364067:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322705536 00000100:00100000:2.0:1788813267.364075:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322705536 00000100:00100000:2.0:1788813267.364116:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788813267.364124:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2101a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+15:15041:x1875706322705536:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813267.367849:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2101a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+15:15041:x1875706322705536:12345-0@lo:501:mount.lustre.0 Request processed in 3718us (4245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813267.367863:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788813267.370366:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322705536:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813267.370425:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322705664:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788813267.370496:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813267.370536:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef36d8c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788813267.370636:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322705664 00000100:00100000:0.0:1788813267.370643:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322705664 00000100:00100000:0.0:1788813267.370721:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788813267.370730:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2101b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+15:15041:x1875706322705664:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813267.370942:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2101b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+15:15041:x1875706322705664:12345-0@lo:503:mount.lustre.0 Request processed in 212us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813267.370949:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788813267.371040:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322705664:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788813267.371496:0:15041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788813267.371555:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322705792:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813267.371594:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813267.371986:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef20e1f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788813267.372070:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322705792 00000100:00100000:3.0:1788813267.372077:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322705792 00000100:00100000:2.0:1788813267.372128:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788813267.372139:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2101a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+15:15041:x1875706322705792:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813267.372295:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2101a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+15:15041:x1875706322705792:12345-0@lo:502:mount.lustre.0 Request processed in 158us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813267.372303:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788813267.372375:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322705792:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788813267.372580:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788813267.372627:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788813267.372676:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788813267.372712:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788813267.372745:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788813267.372836:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788813267.373586:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788813267.373623:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788813267.373660:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322705920:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813267.373718:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813267.373747:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef20e1f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788813267.374099:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322705920 00000100:00100000:2.0:1788813267.374106:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322705920 00000100:00100000:2.0:1788813267.374146:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788813267.374154:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+15:15041:x1875706322705920:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813267.374317:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+15:15041:x1875706322705920:12345-0@lo:502:mount.lustre.0 Request processed in 163us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813267.374324:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788813267.374586:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322705920:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788813267.374693:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788813267.374704:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788813267.375774:0:15059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813267.375915:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813267.375919:0:15059:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788813267.375927:0:15059:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93ef3e0db800 00000020:00000080:0.0:1788813267.375930:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788813267.375937:0:15059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813267.375939:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813267.375949:0:15059:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788813267.375952:0:15059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813267.375955:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813267.375956:0:15059:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788813267.375960:0:15059:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93ef3e0db800 00000020:00000080:0.0:1788813267.375962:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788813267.376110:0:15059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813267.376114:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813267.376116:0:15059:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788813267.376119:0:15059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813267.376121:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813267.376122:0:15059:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788813267.376126:0:15059:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93ef3e0db800 00000020:00000080:0.0:1788813267.376128:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788813267.378984:0:15059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813267.378994:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813267.378997:0:15059:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788813267.379010:0:15059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788813267.379912:0:15041:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788813267.379944:0:15041:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788813267.380007:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef01517200/0x1b294f297b1ed34a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed351 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813267.380021:0:15041:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef01517200/0x1b294f297b1ed34a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed351 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813267.380070:0:15041:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788813267.380073:0:15041:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93ef3e0db800 10000000:01000000:0.0:1788813267.380076:0:15041:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93ef3e0db800 10000000:01000000:0.0:1788813267.380080:0:15041:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788813267.380086:0:15041:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93ef3e0db800 from 1 10000000:01000000:0.0:1788813267.380089:0:15041:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788813267.380131:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef190cfa00/0x1b294f297b1ed358 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813267.380139:0:15041:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef190cfa00/0x1b294f297b1ed358 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813267.380151:0:15041:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef190cfa00/0x1b294f297b1ed358 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813267.380174:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322706048:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788813267.380240:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813267.380277:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322706048 00000100:00100000:0.0:1788813267.380284:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322706048 00000100:00100000:0.0:1788813267.380322:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788813267.380330:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2101a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+15:15041:x1875706322706048:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813267.380343:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813267.380354:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef190ce400/0x1b294f297b1ed35f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ed358 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813267.380376:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef190ce400/0x1b294f297b1ed35f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ed358 expref: 16 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813267.380386:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef190ce400/0x1b294f297b1ed35f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed358 expref: 16 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813267.380394:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190ce400, rc 0) 00000100:00100000:0.0:1788813267.380424:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2101a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:15041:x1875706322706048:12345-0@lo:101:mount.lustre.0 Request processed in 94us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813267.380430:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788813267.380474:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef078b0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813267.380496:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322706048:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813267.380511:0:15041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef190cfa00/0x1b294f297b1ed358 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed35f expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813267.380520:0:15041:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef190cfa00/0x1b294f297b1ed358 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ed35f expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788813267.381085:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788813267.381530:0:15041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813267.381764:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788813267.381850:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788813267.381885:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788813267.381929:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788813267.381962:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788813267.382020:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788813267.382051:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788813267.382077:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788813267.382118:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788813267.382151:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788813267.382179:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788813267.382218:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788813267.382253:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788813267.382285:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788813267.382330:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788813267.382366:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788813267.382397:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788813267.382439:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788813267.382474:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788813267.382509:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788813267.382555:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788813267.382604:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788813267.382650:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788813267.382699:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788813267.382733:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788813267.382766:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788813267.390588:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788813267.390654:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788813267.391324:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788813267.391336:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788813267.391448:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322706176:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813267.391524:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813267.391607:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef078b0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813267.392141:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322706176 00000100:00100000:3.0:1788813267.392151:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322706176 00000100:00100000:3.0:1788813267.392202:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788813267.392211:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:15041:x1875706322706176:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813267.392706:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:15041:x1875706322706176:12345-0@lo:501:mount.lustre.0 Request processed in 495us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813267.392714:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788813267.392722:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322706176:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813267.392761:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322706304:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813267.392829:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813267.392857:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef078b0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813267.392941:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322706304 00000100:00100000:3.0:1788813267.392948:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322706304 00000100:00100000:3.0:1788813267.392972:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788813267.392979:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:15041:x1875706322706304:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788813267.393124:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:15041:x1875706322706304:12345-0@lo:503:mount.lustre.0 Request processed in 144us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813267.393130:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788813267.394148:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322706304:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788813267.395039:0:15041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788813267.395117:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322706432:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813267.395181:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813267.395263:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef078b0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813267.401908:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322706432 00000100:00100000:2.0:1788813267.401921:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322706432 00000100:00100000:2.0:1788813267.401970:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788813267.401979:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:15041:x1875706322706432:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813267.402266:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:15041:x1875706322706432:12345-0@lo:502:mount.lustre.0 Request processed in 287us (7083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813267.402274:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788813267.402334:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322706432:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788813267.402601:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788813267.402656:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788813267.402690:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788813267.402737:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788813267.402772:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788813267.402858:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788813267.402894:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788813267.402927:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788813267.402973:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788813267.403135:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788813267.403174:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788813267.403221:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788813267.403254:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788813267.403297:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788813267.403350:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788813267.403383:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788813267.403413:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788813267.403455:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788813267.403487:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788813267.403516:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788813267.403843:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788813267.403883:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788813267.403915:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788813267.403962:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788813267.404112:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788813267.404145:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788813267.404191:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788813267.404226:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788813267.404877:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788813267.404950:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788813267.404981:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788813267.405162:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788813267.405198:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788813267.405239:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788813267.405269:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788813267.405306:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788813267.405335:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788813267.405362:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788813267.405414:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788813267.405450:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788813267.405496:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322706560:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813267.405633:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813267.405721:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef20e1f480 going to sleep for 11 seconds 00000100:00100000:0.0:1788813267.405762:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322706560 00000100:00100000:0.0:1788813267.405770:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322706560 00000100:00100000:1.0:1788813267.405969:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788813267.405978:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:15041:x1875706322706560:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813267.406293:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:15041:x1875706322706560:12345-0@lo:502:mount.lustre.0 Request processed in 315us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813267.406301:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788813267.407190:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322706560:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788813267.407304:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788813267.407317:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788813267.410839:0:15064:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788813267.410856:0:15064:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93ef3591b380) 00000020:00000080:3.0:1788813267.410890:0:15064:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788813267.410974:0:15064:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93ef3e0db800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788813267.410979:0:15064:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93ef3e0db800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788813267.410982:0:15064:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ef3e0db800 3 00010000:00080000:3.0:1788813267.411014:0:15064:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93ef11774000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.113@tcp at head 00010000:00010000:3.0:1788813267.415224:0:15064:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1788813267.415472:0:15064:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788813267.415513:0:15064:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788813267.415536:0:15064:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1b294f297b1ed36d 00000100:00080000:3.0:1788813267.415546:0:15064:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788813267.415558:0:15064:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93ef11774000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788813267.415596:0:15064:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ef3ae7b480 x1875706322706688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788813267.415624:0:15064:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788813267.415692:0:1248:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813267.415697:0:1248:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788813267.415708:0:1248:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813267.415711:0:1248:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788813267.415765:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322706816:0@lo:400:kworker.0 00000100:00100000:2.0:1788813267.415840:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1875706322706688:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788813267.415868:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813267.415918:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322706816 00000100:00100000:0.0:1788813267.415925:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322706816 00000100:00100000:0.0:1788813267.415961:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788813267.415970:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322706816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813267.416027:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322706816:12345-0@lo:400:kworker.0 Request processed in 57us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813267.416034:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788813267.416058:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813267.416094:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322706688 00000100:00100000:0.0:1788813267.416098:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322706688 00010000:00080000:2.0:1788813267.416106:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93ef36eca680 x1875706322706816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813267.416113:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788813267.416117:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3298:x1875706322706688:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788813267.416120:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322706816:0@lo:400:kworker.0 00010000:00080000:0.0:1788813267.416150:0:14360:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 427 last 0 00000020:00000080:0.0:1788813267.416179:0:14360:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1b294f297b1ed374 00000004:00100000:0.0:1788813267.416192:0:14360:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788813267.416218:0:14360:0:(import.c:65:import_set_state_nolock()) ffff93ef21257800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788813267.416266:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875706322706688:12345-0@lo:38:llog_process_th.0 Request processed in 148us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813267.416273:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1788813267.416489:0:15064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:2.0:1788813267.416573:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93ef3ae7b480 x1875706322706688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813267.416582:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788813267.416587:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788813267.416593:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788813267.416597:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788813267.416600:0:3298:0:(import.c:65:import_set_state_nolock()) ffff93ef11774000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788813267.416605:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1875706322706688:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1788813267.419406:0:15041:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788813267.419468:0:15041:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788813267.419495:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef190cfa00/0x1b294f297b1ed358 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed35f expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813267.419509:0:15041:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef190cfa00/0x1b294f297b1ed358 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed35f expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788813267.419558:0:15041:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788813267.419565:0:15041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788813267.419566:0:15041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813267.419567:0:15041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788813267.419568:0:15041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813267.419570:0:15041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813267.419571:0:15041:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788813267.419572:0:15041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813267.419574:0:15041:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788813267.419578:0:15041:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788813267.419580:0:15041:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788813267.419581:0:15041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788813267.419582:0:15041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813267.419583:0:15041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788813267.419584:0:15041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813267.419584:0:15041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813267.419585:0:15041:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788813267.419586:0:15041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813267.419587:0:15041:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788813267.419612:0:15041:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788813267.419632:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322706944:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788813267.419696:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813267.419728:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322706944 00000100:00100000:1.0:1788813267.419735:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3c6c0000 going to sleep for 11 seconds 00000100:00100000:2.0:1788813267.419736:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322706944 00000100:00100000:2.0:1788813267.419823:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788813267.419833:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:15041:x1875706322706944:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788813267.419871:0:14352:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788813267.419884:0:14352:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788813267.447311:0:14352:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788813267.447326:0:14352:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788813267.447363:0:14375:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788813267.447369:0:14375:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788813267.447392:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ef01516c00/0x1b294f297b1ed37b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813267.447682:0:14375:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef21619000/0x1b294f297b1ed2e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed2e1 expref: 16 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813267.447693:0:14375:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ef01516c00/0x1b294f297b1ed37b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813267.447731:0:14375:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef21619000/0x1b294f297b1ed2e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ed2e1 expref: 16 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813267.447764:0:14375:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ef21619000/0x1b294f297b1ed2e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ed2e1 expref: 16 pid: 14354 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813267.447817:0:14375:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae79180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14375:1875706322707072:0@lo:104: 00000100:00100000:3.0:1788813267.447882:0:14375:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813267.447922:0:14375:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef36d8c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788813267.448069:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322707072 00000100:00100000:2.0:1788813267.448077:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322707072 00000100:00100000:2.0:1788813267.448118:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788813267.448126:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+3:14375:x1875706322707072:12345-0@lo:104: 00010000:00010000:2.0:1788813267.448140:0:14342:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef190cee00/0x1b294f297b1ed2e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ed2e8 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813267.448189:0:14342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788813267.448194:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+3:14375:x1875706322707072:12345-0@lo:104: Request processed in 70us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813267.448201:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788813267.448687:0:14375:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae79180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14375:1875706322707072:0@lo:104: 00010000:00010000:3.0:1788813267.448706:0:14375:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ef01516c00/0x1b294f297b1ed37b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813267.448720:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813267.448725:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef190cee00/0x1b294f297b1ed2e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ed2e8 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813267.448733:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef190cee00 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:3.0:1788813267.448736:0:14347:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef190cee00/0x1b294f297b1ed2e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ed2e8 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813267.448744:0:14347:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef190cee00/0x1b294f297b1ed2e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ed2e8 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813267.448752:0:14347:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef190cee00/0x1b294f297b1ed2e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ed2e8 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813267.448757:0:14347:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813267.448822:0:14347:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef190cee00/0x1b294f297b1ed2e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ed2e8 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813267.448829:0:14347:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813267.448867:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef190cee00/0x1b294f297b1ed2e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ed2e8 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813267.448874:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef190cee00/0x1b294f297b1ed2e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ed2e8 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813267.448890:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813267.448892:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813267.448894:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813267.449046:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3302:1875706322707200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813267.449083:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813267.450220:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322707200 00000100:00100000:1.0:1788813267.450229:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322707200 00010000:00010000:1.0:1788813267.450264:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef21619000/0x1b294f297b1ed2e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ed2e1 expref: 17 pid: 14354 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813267.450299:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813267.450308:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+17:3302:x1875706322707200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813267.450320:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813267.450325:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef21619000/0x1b294f297b1ed2e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ed2e1 expref: 17 pid: 14354 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813267.450359:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef21619000/0x1b294f297b1ed2e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ed2e1 expref: 17 pid: 14354 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813267.450374:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef21619000/0x1b294f297b1ed2e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ed2e1 expref: 17 pid: 14354 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813267.450389:0:14346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ef01516c00/0x1b294f297b1ed37b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813267.450397:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef01516c00/0x1b294f297b1ed37b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788813267.450603:0:14346:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003235640s 00010000:00010000:1.0:1788813267.450609:0:14346:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ef01516c00/0x1b294f297b1ed37b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813267.450617:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ef01516c00/0x1b294f297b1ed37b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813267.450624:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ef01516c00/0x1b294f297b1ed37b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813267.450630:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ef01516c00/0x1b294f297b1ed37b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813267.450635:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef01516c00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:1.0:1788813267.450639:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ef01516c00/0x1b294f297b1ed37b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813267.450648:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ef01516c00/0x1b294f297b1ed37b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813267.450674:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ef01516c00/0x1b294f297b1ed37b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813267.450685:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813267.450738:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:3302:x1875706322707200:12345-0@lo:103:ldlm_bl.0 Request processed in 431us (1654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813267.450746:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813267.450817:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3302:1875706322707200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813267.450885:0:14375:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ef01516c00/0x1b294f297b1ed37b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813267.450894:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ef01516c00/0x1b294f297b1ed37b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813267.450901:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef01516c00/0x1b294f297b1ed37b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813267.457096:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+15:15041:x1875706322706944:12345-0@lo:253:mount.lustre.0 Request processed in 37256us (37391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813267.457111:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788813267.457202:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15041:1875706322706944:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788813267.457218:0:15041:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788813267.457222:0:15041:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788813267.457224:0:15041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788813267.457226:0:15041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813267.457227:0:15041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788813267.457228:0:15041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813267.457230:0:15041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813267.457231:0:15041:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788813267.457232:0:15041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813267.457234:0:15041:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788813267.457314:0:15041:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788813267.463004:0:15041:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788813267.463169:0:15041:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788813267.463374:0:15041:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788813267.463961:0:15041:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788813267.464119:0:15041:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788813267.464595:0:15041:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788813267.465642:0:15041:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788813267.514141:0:15041:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788813267.514150:0:15041:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788813267.514181:0:15041:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788813267.514254:0:15041:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788813267.514273:0:15041:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788813267.514302:0:15041:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788813267.742918:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813268.765062:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788813269.406060:0:14357:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788813269.406068:0:14357:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93ef36653800 from 7 10000000:01000000:3.0:1788813269.406073:0:14357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788813269.406117:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef01516800/0x1b294f297b1ed382 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813269.406130:0:14357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef01516800/0x1b294f297b1ed382 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813269.406141:0:14357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef01516800/0x1b294f297b1ed382 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813269.406167:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322707328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788813269.406298:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813269.406378:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1219f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813269.411543:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322707328 00000100:00100000:1.0:1788813269.411556:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322707328 00000100:00100000:1.0:1788813269.411633:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788813269.411644:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+15:14357:x1875706322707328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813269.411659:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813269.411679:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef354fd800/0x1b294f297b1ed389 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ed382 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813269.411704:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef354fd800/0x1b294f297b1ed389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ed382 expref: 16 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813269.411716:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef354fd800/0x1b294f297b1ed389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed382 expref: 16 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813269.411725:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fd800, rc 0) 00000100:00100000:1.0:1788813269.411833:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:14357:x1875706322707328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (5535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813269.411840:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788813269.411894:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322707328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813269.412015:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef01516800/0x1b294f297b1ed382 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed389 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813269.412025:0:14357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef01516800/0x1b294f297b1ed382 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ed389 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813269.412091:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322707456:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788813269.412128:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813269.412159:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2ece2900 going to sleep for 11 seconds 00000100:00100000:1.0:1788813269.412172:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322707456 00000100:00100000:1.0:1788813269.412176:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322707456 00000100:00100000:1.0:1788813269.412204:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788813269.412210:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:14357:x1875706322707456:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788813269.412222:0:14352:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788813269.412247:0:14352:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788813269.412251:0:14352:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788813269.412316:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:14357:x1875706322707456:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813269.412322:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788813269.412350:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322707456:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788813269.412400:0:14357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788813269.412406:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef01516800/0x1b294f297b1ed382 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed389 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813269.412415:0:14357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef01516800/0x1b294f297b1ed382 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed389 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813269.790247:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813270.813008:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813271.837885:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788813272.733141:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813272.733149:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788813272.733165:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813272.733168:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788813272.733244:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3299:1875706322707584:0@lo:400:kworker.0 00000100:00100000:0.0:1788813272.733321:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813272.733374:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813272.733381:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36eca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322707712:0@lo:400:kworker.0 00000100:00100000:0.0:1788813272.733424:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813272.733460:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322707840:0@lo:400:kworker.0 00000100:00100000:0.0:1788813272.733487:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813272.733823:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322707584 00000100:00100000:0.0:1788813272.733832:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322707584 00000100:00100000:0.0:1788813272.733874:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788813272.733883:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:3299:x1875706322707584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813272.733931:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:3299:x1875706322707584:12345-0@lo:400:kworker.0 Request processed in 49us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813272.733938:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788813272.734030:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322707712 00000100:00100000:0.0:1788813272.734035:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322707712 00000100:00100000:0.0:1788813272.734057:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322707840 00000100:00100000:0.0:1788813272.734060:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322707840 00000100:00100000:0.0:1788813272.734092:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788813272.734097:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322707712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813272.734130:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322707712:12345-0@lo:400:kworker.0 Request processed in 33us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813272.734137:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788813272.734149:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788813272.734164:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322707840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813272.734197:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322707840:12345-0@lo:400:kworker.0 Request processed in 34us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813272.734202:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788813272.734250:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef36ec8000 x1875706322707840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813272.734264:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322707840:0@lo:400:kworker.0 00010000:00080000:0.0:1788813272.734436:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef36eca300 x1875706322707712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813272.734445:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36eca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322707712:0@lo:400:kworker.0 00000100:00100000:0.0:1788813272.734456:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3299:1875706322707584:0@lo:400:kworker.0 00000100:00080000:2.0:1788813272.735768:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788813272.861016:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813273.887997:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788813273.920846:0:15410:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788813274.909431:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788813275.165775:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788813275.933153:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813276.956950:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788813277.853151:0:1248:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813277.853159:0:1248:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788813277.853162:0:1248:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813277.853165:0:1248:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788813277.853382:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813277.853402:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3301:1875706322707968:0@lo:400:kworker.0 00000100:00100000:3.0:1788813277.853482:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813277.853535:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322708096:0@lo:400:kworker.0 00000100:00100000:3.0:1788813277.853562:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813277.853583:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813277.853588:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322708224:0@lo:400:kworker.0 00000100:00100000:3.0:1788813277.853612:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813277.853648:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322708096 00000100:00100000:3.0:1788813277.853655:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322708096 00000100:00100000:3.0:1788813277.853699:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322708224 00000100:00100000:3.0:1788813277.853702:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322708224 00000100:00100000:3.0:1788813277.853739:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788813277.853747:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322708096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813277.854021:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322708096:12345-0@lo:400:kworker.0 Request processed in 273us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813277.854030:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788813277.854048:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788813277.854055:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322708224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813277.854084:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322708224:12345-0@lo:400:kworker.0 Request processed in 31us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813277.854525:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788813277.854575:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef3ae7a300 x1875706322708224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813277.854592:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322708224:0@lo:400:kworker.0 00010000:00080000:3.0:1788813277.854604:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef3ae79f80 x1875706322708096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813277.854613:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322708096:0@lo:400:kworker.0 00000100:00100000:2.0:1788813277.854978:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322707968 00000100:00100000:2.0:1788813277.854986:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322707968 00000100:00100000:2.0:1788813277.855024:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788813277.855032:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:3301:x1875706322707968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813277.855101:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:3301:x1875706322707968:12345-0@lo:400:kworker.0 Request processed in 58us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813277.855108:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1788813277.855147:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813277.860155:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3301:1875706322707968:0@lo:400:kworker.0 00010000:00010000:3.0:1788813277.981233:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813278.696074:0:3298:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813263/real 1788813263] req@ffff93ef36161180 x1875706322704000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813278 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813278.696120:0:3298:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93ef36161180 x1875706322704000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813278 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813278.696133:0:3298:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813263/real 1788813263] req@ffff93ef36161500 x1875706322704128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813278 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813278.696145:0:3298:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93ef36161500 x1875706322704128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813278 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788813278.696169:0:3298:0:(import.c:65:import_set_state_nolock()) ffff93ee06e9a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788813278.696200:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788813278.696205:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36161180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1875706322704000:0@lo:8:kworker.0 00000100:00080000:2.0:1788813278.696231:0:3298:0:(import.c:65:import_set_state_nolock()) ffff93ef3ad93000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788813278.696238:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788813278.696242:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36161500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1875706322704128:0@lo:8:kworker.0 00000100:00080000:2.0:1788813278.696353:0:1248:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813278.696358:0:1248:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788813278.696361:0:1248:0:(import.c:65:import_set_state_nolock()) ffff93ee06e9a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788813278.696367:0:1248:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 423 00000100:00080000:2.0:1788813278.696374:0:1248:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788813278.696388:0:1248:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93ee06e9a000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788813278.696411:0:1248:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ef36161180 x1875706322708480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788813278.696427:0:1248:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813278.696430:0:1248:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788813278.696432:0:1248:0:(import.c:65:import_set_state_nolock()) ffff93ef3ad93000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788813278.696435:0:1248:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 423 00000100:00080000:2.0:1788813278.696439:0:1248:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788813278.696443:0:1248:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93ef3ad93000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788813278.696456:0:1248:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ef36163b80 x1875706322708608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813278.696509:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36161500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3301:1875706322708352:0@lo:400:kworker.0 00000100:00100000:2.0:1788813278.696591:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813278.696648:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813278.696655:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322708736:0@lo:400:kworker.0 00000100:00100000:2.0:1788813278.696684:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813278.696739:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36161880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322708864:0@lo:400:kworker.0 00000100:00100000:2.0:1788813278.696767:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813278.696827:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322708352 00000100:00100000:2.0:1788813278.696837:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322708352 00000100:00100000:2.0:1788813278.696891:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788813278.696902:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:3301:x1875706322708352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813278.696951:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:3301:x1875706322708352:12345-0@lo:400:kworker.0 Request processed in 51us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813278.696958:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788813278.696991:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322708736 00000100:00100000:2.0:1788813278.696995:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322708736 00000100:00100000:2.0:1788813278.697030:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322708864 00000100:00100000:2.0:1788813278.697033:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322708864 00000100:00100000:2.0:1788813278.697050:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788813278.697056:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322708736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813278.697087:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875706322708736:12345-0@lo:400:kworker.0 Request processed in 31us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813278.697093:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788813278.697106:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788813278.697112:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322708864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813278.697142:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322708864:12345-0@lo:400:kworker.0 Request processed in 31us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813278.697148:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788813278.697188:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef36161c00 x1875706322708736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813278.697202:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875706322708736:0@lo:400:kworker.0 00000100:00100000:2.0:1788813278.697225:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36161500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3301:1875706322708352:0@lo:400:kworker.0 00010000:00080000:2.0:1788813278.697267:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef36161880 x1875706322708864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813278.697276:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36161880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322708864:0@lo:400:kworker.0 00000100:00100000:2.0:1788813278.697291:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36161180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1875706322708480:0@lo:8:kworker.0 00000100:00100000:2.0:1788813278.697318:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813278.697348:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36163b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1875706322708608:0@lo:8:kworker.0 00000100:00100000:2.0:1788813278.697367:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813278.698632:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322708480 00000100:00100000:2.0:1788813278.698646:0:15043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322708480 00000100:00100000:2.0:1788813278.698680:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322708608 00000100:00100000:2.0:1788813278.698683:0:15043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322708608 00000100:00100000:2.0:1788813278.698703:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788813278.698710:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3298:x1875706322708480:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788813278.698755:0:15043:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:2.0:1788813278.699588:0:15043:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b294f297b1ed390 00002000:00100000:2.0:1788813278.699613:0:15043:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93ef36610000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788813278.699618:0:15043:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788813278.699622:0:15043:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788813278.700476:0:15043:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788813278.700519:0:15043:0:(import.c:65:import_set_state_nolock()) ffff93ef36611800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788813278.700644:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1875706322708480:12345-0@lo:8:kworker.0 Request processed in 1931us (3321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813278.700655:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788813278.700690:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813278.700713:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3298:x1875706322708608:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788813278.700743:0:15043:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788813278.700777:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3298:x1875706322708608:12345-0@lo:8:kworker.0 Request processed in 64us (3409us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788813278.700798:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788813278.700843:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef36161180 x1875706322708480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788813298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813278.700856:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788813278.700866:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788813278.700876:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788813278.700883:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788813278.700886:0:3298:0:(import.c:65:import_set_state_nolock()) ffff93ee06e9a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788813278.700912:0:3298:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788813278.700918:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36161180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1875706322708480:0@lo:8:kworker.0 00000100:00080000:3.0:1788813278.700940:0:3298:0:(import.c:65:import_set_state_nolock()) ffff93ef3ad93000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813278.700946:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788813278.700949:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36163b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1875706322708608:0@lo:8:kworker.0 00000004:00080000:2.0:1788813278.700971:0:14382:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1788813278.700994:0:14382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36160380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14382:1875706322709120:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788813278.701037:0:14381:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788813278.701053:0:14382:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813278.701079:0:14382:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2a1f4540 going to sleep for 11 seconds 00000100:00100000:2.0:1788813278.701096:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322708992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813278.701128:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813278.701164:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322709120 00000100:00100000:2.0:1788813278.701172:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322709120 00000100:00100000:2.0:1788813278.701218:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788813278.701225:0:15044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14382:x1875706322709120:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1788813278.701439:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813278.701462:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322708992 00000100:00100000:3.0:1788813278.701473:0:15046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322708992 00000004:00080000:0.0:1788813278.701535:0:14381:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 439087752092ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788813278.701759:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788813278.701767:0:15046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36163800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1875706322708992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813278.701818:0:15046:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813278.701872:0:15046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36163800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1875706322708992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813278.701879:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788813278.702362:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef36161c00 x1875706322708992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813278.702443:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322708992:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1788813278.705323:0:15044:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788813278.705338:0:15044:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788813278.705344:0:15044:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:3.0:1788813278.714496:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813278.714509:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f721b50b/0x1b294f297b1ed397 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.714527:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788813278.714532:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813278.714538:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f721b50b/0x1b294f297b1ed397 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.714555:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f721b50b/0x1b294f297b1ed397 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.714564:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f721b50b/0x1b294f297b1ed397 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.714580:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f721b50b/0x1b294f297b1ed397 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.714607:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813278.714697:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813278.714711:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f721b50b/0x1b294f297b1ed397 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.714734:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef01516c00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:2.0:1788813278.714740:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f721b50b/0x1b294f297b1ed397 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.714754:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f721b50b/0x1b294f297b1ed397 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.714830:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f721b50b/0x1b294f297b1ed397 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.714841:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f721b50b/0x1b294f297b1ed397 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.714873:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813278.714875:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813278.714877:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813278.716013:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813278.716023:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000766918a3/0x1b294f297b1ed39e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.716039:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788813278.716043:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813278.716049:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000766918a3/0x1b294f297b1ed39e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.716061:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000766918a3/0x1b294f297b1ed39e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.716070:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000766918a3/0x1b294f297b1ed39e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.716078:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000766918a3/0x1b294f297b1ed39e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.716094:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813278.716107:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813278.716113:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000766918a3/0x1b294f297b1ed39e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.716193:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef01516000 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813278.716198:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000766918a3/0x1b294f297b1ed39e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.716207:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000766918a3/0x1b294f297b1ed39e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.716222:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000766918a3/0x1b294f297b1ed39e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.716229:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000766918a3/0x1b294f297b1ed39e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.716247:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813278.716249:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813278.716251:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813278.716696:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813278.716703:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e2af61/0x1b294f297b1ed3a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.716712:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788813278.717639:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813278.717652:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e2af61/0x1b294f297b1ed3a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.717671:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003e2af61/0x1b294f297b1ed3a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.717695:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e2af61/0x1b294f297b1ed3a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.717704:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003e2af61/0x1b294f297b1ed3a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.718234:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813278.718690:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813278.718704:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003e2af61/0x1b294f297b1ed3a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.718729:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214c400 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:1.0:1788813278.718735:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e2af61/0x1b294f297b1ed3a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.718747:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e2af61/0x1b294f297b1ed3a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.718825:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003e2af61/0x1b294f297b1ed3a5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.718834:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003e2af61/0x1b294f297b1ed3a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.718864:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813278.718867:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813278.718869:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813278.720032:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813278.720044:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a5d764/0x1b294f297b1ed3ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.720060:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788813278.720064:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813278.720070:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012a5d764/0x1b294f297b1ed3ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.720084:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012a5d764/0x1b294f297b1ed3ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.720094:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012a5d764/0x1b294f297b1ed3ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.720103:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012a5d764/0x1b294f297b1ed3ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.720210:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813278.720259:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813278.720271:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012a5d764/0x1b294f297b1ed3ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.720284:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214c800 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:1.0:1788813278.720289:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a5d764/0x1b294f297b1ed3ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.720301:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012a5d764/0x1b294f297b1ed3ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.720324:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012a5d764/0x1b294f297b1ed3ac lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.720332:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012a5d764/0x1b294f297b1ed3ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.720377:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813278.720380:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813278.720382:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813278.722049:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813278.722063:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed3b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.722080:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788813278.722085:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813278.722093:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed3b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.722110:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed3b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.722302:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed3b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.722312:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed3b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.722339:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813278.722358:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813278.722364:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed3b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.722372:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214c000 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813278.722387:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed3b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.722397:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed3b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.722421:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed3b3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.722429:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed3b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.722481:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813278.722485:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813278.722492:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813278.723367:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813278.723377:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e8f1fa0/0x1b294f297b1ed3ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.723390:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788813278.723394:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813278.723400:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e8f1fa0/0x1b294f297b1ed3ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.723412:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e8f1fa0/0x1b294f297b1ed3ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.723421:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e8f1fa0/0x1b294f297b1ed3ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.723436:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e8f1fa0/0x1b294f297b1ed3ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.723459:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813278.723475:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813278.723480:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e8f1fa0/0x1b294f297b1ed3ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.723487:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214ca00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813278.723492:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e8f1fa0/0x1b294f297b1ed3ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.723501:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e8f1fa0/0x1b294f297b1ed3ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.723514:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e8f1fa0/0x1b294f297b1ed3ba lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.723522:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e8f1fa0/0x1b294f297b1ed3ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.723547:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813278.723549:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813278.723551:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813278.724537:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813278.724556:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000501f7a05/0x1b294f297b1ed3c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.724569:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788813278.724573:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813278.724579:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000501f7a05/0x1b294f297b1ed3c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.724593:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000501f7a05/0x1b294f297b1ed3c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.724603:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000501f7a05/0x1b294f297b1ed3c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.724612:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000501f7a05/0x1b294f297b1ed3c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.724640:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813278.724681:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813278.724693:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000501f7a05/0x1b294f297b1ed3c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.724708:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214dc00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:1.0:1788813278.724713:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000501f7a05/0x1b294f297b1ed3c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.724736:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000501f7a05/0x1b294f297b1ed3c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.724759:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000501f7a05/0x1b294f297b1ed3c1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.724767:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000501f7a05/0x1b294f297b1ed3c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.724830:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813278.724833:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813278.724835:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813278.728984:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813278.729000:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed3c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.729018:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788813278.729023:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813278.729030:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed3c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.729045:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed3c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.729063:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed3c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.729071:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed3c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.729106:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813278.729136:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813278.729151:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed3c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.729193:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214c000 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:1.0:1788813278.729199:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed3c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.729211:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed3c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.729237:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed3c8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.729245:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed3c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.729278:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813278.729281:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813278.729283:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813278.730151:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813278.730162:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e76cc499/0x1b294f297b1ed3cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.730177:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788813278.730180:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813278.730186:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e76cc499/0x1b294f297b1ed3cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.730199:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e76cc499/0x1b294f297b1ed3cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.730209:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e76cc499/0x1b294f297b1ed3cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.730217:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e76cc499/0x1b294f297b1ed3cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.730257:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813278.730279:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813278.730285:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e76cc499/0x1b294f297b1ed3cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.730295:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214de00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813278.730302:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e76cc499/0x1b294f297b1ed3cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.730313:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e76cc499/0x1b294f297b1ed3cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.730335:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e76cc499/0x1b294f297b1ed3cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.730342:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e76cc499/0x1b294f297b1ed3cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.730372:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813278.730375:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813278.730378:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813278.733429:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813278.733444:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d70ac82/0x1b294f297b1ed3d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.733461:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788813278.733473:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813278.733479:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d70ac82/0x1b294f297b1ed3d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.733493:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d70ac82/0x1b294f297b1ed3d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.733503:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d70ac82/0x1b294f297b1ed3d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.733510:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d70ac82/0x1b294f297b1ed3d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.733534:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813278.733935:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813278.733950:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d70ac82/0x1b294f297b1ed3d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.733964:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214da00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:1.0:1788813278.733970:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d70ac82/0x1b294f297b1ed3d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.733982:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d70ac82/0x1b294f297b1ed3d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.734082:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d70ac82/0x1b294f297b1ed3d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.734093:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d70ac82/0x1b294f297b1ed3d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.734126:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813278.734129:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813278.734131:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813278.734538:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813278.734547:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032c0eb3b/0x1b294f297b1ed3dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.734559:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788813278.734562:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813278.734568:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032c0eb3b/0x1b294f297b1ed3dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.734579:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032c0eb3b/0x1b294f297b1ed3dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.734587:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032c0eb3b/0x1b294f297b1ed3dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.734601:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032c0eb3b/0x1b294f297b1ed3dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.734621:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813278.734753:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813278.734761:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032c0eb3b/0x1b294f297b1ed3dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.734771:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214ce00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:1.0:1788813278.734775:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032c0eb3b/0x1b294f297b1ed3dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.734818:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032c0eb3b/0x1b294f297b1ed3dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.734837:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032c0eb3b/0x1b294f297b1ed3dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.734846:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032c0eb3b/0x1b294f297b1ed3dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.734892:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813278.734895:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813278.734899:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813278.735451:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813278.735460:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013bd3572/0x1b294f297b1ed3e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.735472:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788813278.735476:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813278.735481:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013bd3572/0x1b294f297b1ed3e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.735493:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013bd3572/0x1b294f297b1ed3e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.735501:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013bd3572/0x1b294f297b1ed3e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.735507:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013bd3572/0x1b294f297b1ed3e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.735528:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813278.735843:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813278.735852:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013bd3572/0x1b294f297b1ed3e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.735862:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214d200 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:1.0:1788813278.735866:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013bd3572/0x1b294f297b1ed3e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.735875:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013bd3572/0x1b294f297b1ed3e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.735891:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013bd3572/0x1b294f297b1ed3e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.735899:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013bd3572/0x1b294f297b1ed3e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.735922:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813278.735924:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813278.735925:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813278.739254:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813278.739272:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abf1a22e/0x1b294f297b1ed3eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.739294:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788813278.739299:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813278.739307:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abf1a22e/0x1b294f297b1ed3eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.739324:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abf1a22e/0x1b294f297b1ed3eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.739337:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abf1a22e/0x1b294f297b1ed3eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.739346:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abf1a22e/0x1b294f297b1ed3eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.739387:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813278.739818:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813278.739828:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abf1a22e/0x1b294f297b1ed3eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.739839:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619600 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813278.739844:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abf1a22e/0x1b294f297b1ed3eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.739856:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abf1a22e/0x1b294f297b1ed3eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.739891:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abf1a22e/0x1b294f297b1ed3eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.739900:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abf1a22e/0x1b294f297b1ed3eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.739922:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813278.739924:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813278.739926:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813278.740312:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813278.740319:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ed3f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.740331:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788813278.740335:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813278.740341:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ed3f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.740352:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ed3f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.740361:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ed3f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.740369:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ed3f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.740428:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788813278.741196:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813278.741206:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdc831f7/0x1b294f297b1ed3f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.741219:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788813278.741232:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813278.741238:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdc831f7/0x1b294f297b1ed3f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.741252:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdc831f7/0x1b294f297b1ed3f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.741263:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdc831f7/0x1b294f297b1ed3f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.741271:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdc831f7/0x1b294f297b1ed3f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.742540:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788813278.742556:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ed3f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.742573:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619200 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813278.742579:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ed3f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.742592:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ed3f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.742616:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ed3f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.742624:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e8560ab/0x1b294f297b1ed3f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.743331:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813278.743337:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdc831f7/0x1b294f297b1ed3f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.743345:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618400 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813278.743349:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdc831f7/0x1b294f297b1ed3f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.743358:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdc831f7/0x1b294f297b1ed3f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.743373:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdc831f7/0x1b294f297b1ed3f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.743382:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813278.743383:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813278.743386:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813278.743776:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788813278.743802:0:15044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdc831f7/0x1b294f297b1ed3f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.744127:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813278.745249:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813278.745262:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e76cc499/0x1b294f297b1ed400 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.745285:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788813278.745290:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813278.745297:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e76cc499/0x1b294f297b1ed400 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.745312:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e76cc499/0x1b294f297b1ed400 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.745323:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e76cc499/0x1b294f297b1ed400 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.745330:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e76cc499/0x1b294f297b1ed400 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.745358:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813278.745837:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813278.745849:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e76cc499/0x1b294f297b1ed400 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.745862:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214de00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813278.745867:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e76cc499/0x1b294f297b1ed400 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.745894:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e76cc499/0x1b294f297b1ed400 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.745917:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e76cc499/0x1b294f297b1ed400 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.745926:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e76cc499/0x1b294f297b1ed400 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.745951:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813278.745953:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813278.745955:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813278.746229:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813278.746238:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e8f1fa0/0x1b294f297b1ed407 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.746251:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788813278.746255:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813278.746261:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e8f1fa0/0x1b294f297b1ed407 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.746273:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e8f1fa0/0x1b294f297b1ed407 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.746293:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e8f1fa0/0x1b294f297b1ed407 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.746301:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e8f1fa0/0x1b294f297b1ed407 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.746325:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813278.746353:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813278.746362:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e8f1fa0/0x1b294f297b1ed407 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.746373:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214ca00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:2.0:1788813278.746378:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e8f1fa0/0x1b294f297b1ed407 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.746387:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e8f1fa0/0x1b294f297b1ed407 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.746418:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e8f1fa0/0x1b294f297b1ed407 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.746426:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e8f1fa0/0x1b294f297b1ed407 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.746458:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813278.746463:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813278.746468:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813278.748203:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813278.748216:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bcdd0be/0x1b294f297b1ed40e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.748233:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788813278.748237:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813278.748243:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bcdd0be/0x1b294f297b1ed40e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.748258:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bcdd0be/0x1b294f297b1ed40e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.748268:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bcdd0be/0x1b294f297b1ed40e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.748276:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bcdd0be/0x1b294f297b1ed40e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.748316:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813278.748761:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813278.748775:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bcdd0be/0x1b294f297b1ed40e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.748817:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214d800 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:1.0:1788813278.748822:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bcdd0be/0x1b294f297b1ed40e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.748834:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bcdd0be/0x1b294f297b1ed40e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.748859:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bcdd0be/0x1b294f297b1ed40e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.748867:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bcdd0be/0x1b294f297b1ed40e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.748891:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813278.748893:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813278.748895:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813278.749695:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813278.749706:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7bfc6cd/0x1b294f297b1ed415 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.749737:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788813278.749741:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813278.749747:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7bfc6cd/0x1b294f297b1ed415 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.749760:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7bfc6cd/0x1b294f297b1ed415 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.749769:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7bfc6cd/0x1b294f297b1ed415 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.749776:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7bfc6cd/0x1b294f297b1ed415 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.749818:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813278.749871:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813278.749880:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7bfc6cd/0x1b294f297b1ed415 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.749892:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214c200 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:1.0:1788813278.749896:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7bfc6cd/0x1b294f297b1ed415 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.749907:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7bfc6cd/0x1b294f297b1ed415 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.749933:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7bfc6cd/0x1b294f297b1ed415 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.749940:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7bfc6cd/0x1b294f297b1ed415 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.749962:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813278.749964:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813278.749965:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813278.750508:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813278.750516:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004075bd9c/0x1b294f297b1ed41c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.750528:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788813278.750541:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813278.750547:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004075bd9c/0x1b294f297b1ed41c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.750558:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004075bd9c/0x1b294f297b1ed41c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.750567:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004075bd9c/0x1b294f297b1ed41c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.750574:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004075bd9c/0x1b294f297b1ed41c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.750596:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813278.750643:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813278.750652:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004075bd9c/0x1b294f297b1ed41c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.750662:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214cc00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:1.0:1788813278.750667:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004075bd9c/0x1b294f297b1ed41c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.750677:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004075bd9c/0x1b294f297b1ed41c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.750692:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004075bd9c/0x1b294f297b1ed41c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.750700:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004075bd9c/0x1b294f297b1ed41c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.750743:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813278.750745:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813278.750747:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813278.751296:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813278.751304:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000770c0ed4/0x1b294f297b1ed423 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.751314:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788813278.751317:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813278.751323:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000770c0ed4/0x1b294f297b1ed423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.751332:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000770c0ed4/0x1b294f297b1ed423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.751339:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000770c0ed4/0x1b294f297b1ed423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.751352:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000770c0ed4/0x1b294f297b1ed423 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.751371:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813278.751423:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813278.751432:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000770c0ed4/0x1b294f297b1ed423 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.751443:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214d600 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:1.0:1788813278.751448:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000770c0ed4/0x1b294f297b1ed423 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.751458:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000770c0ed4/0x1b294f297b1ed423 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.751475:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000770c0ed4/0x1b294f297b1ed423 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.751483:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000770c0ed4/0x1b294f297b1ed423 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813278.751514:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813278.751516:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813278.751519:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813278.755268:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813278.755282:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaaca509/0x1b294f297b1ed42a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.755298:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788813278.755303:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813278.755310:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaaca509/0x1b294f297b1ed42a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.755324:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaaca509/0x1b294f297b1ed42a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.755334:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaaca509/0x1b294f297b1ed42a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.755342:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaaca509/0x1b294f297b1ed42a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.755372:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813278.755417:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813278.755430:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaaca509/0x1b294f297b1ed42a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.755445:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214d000 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:2.0:1788813278.755451:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaaca509/0x1b294f297b1ed42a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.755464:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaaca509/0x1b294f297b1ed42a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.755491:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaaca509/0x1b294f297b1ed42a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.755500:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaaca509/0x1b294f297b1ed42a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.755550:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813278.755552:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813278.755555:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813278.756696:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813278.756705:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d226b5e/0x1b294f297b1ed431 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.756742:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788813278.756746:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813278.756751:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d226b5e/0x1b294f297b1ed431 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.756764:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d226b5e/0x1b294f297b1ed431 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.756773:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d226b5e/0x1b294f297b1ed431 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.756811:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d226b5e/0x1b294f297b1ed431 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.756975:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788813278.757518:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813278.757525:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013bd3572/0x1b294f297b1ed438 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.757537:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788813278.757540:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813278.757545:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013bd3572/0x1b294f297b1ed438 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.757555:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013bd3572/0x1b294f297b1ed438 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.757575:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013bd3572/0x1b294f297b1ed438 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.757581:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013bd3572/0x1b294f297b1ed438 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.757599:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788813278.758641:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813278.758649:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032c0eb3b/0x1b294f297b1ed43f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.758660:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788813278.758663:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813278.758668:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032c0eb3b/0x1b294f297b1ed43f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.758678:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032c0eb3b/0x1b294f297b1ed43f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.758687:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032c0eb3b/0x1b294f297b1ed43f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.758694:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032c0eb3b/0x1b294f297b1ed43f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.759098:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788813278.759113:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d226b5e/0x1b294f297b1ed431 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.759127:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214c600 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813278.759133:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d226b5e/0x1b294f297b1ed431 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.759145:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d226b5e/0x1b294f297b1ed431 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.759180:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d226b5e/0x1b294f297b1ed431 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.759204:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788813278.759207:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d226b5e/0x1b294f297b1ed431 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.759244:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788813278.759248:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013bd3572/0x1b294f297b1ed438 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.759256:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214d200 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813278.759260:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013bd3572/0x1b294f297b1ed438 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.759268:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013bd3572/0x1b294f297b1ed438 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.759281:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013bd3572/0x1b294f297b1ed438 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.759289:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013bd3572/0x1b294f297b1ed438 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.759315:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813278.759319:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032c0eb3b/0x1b294f297b1ed43f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.759326:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214ce00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813278.759337:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032c0eb3b/0x1b294f297b1ed43f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.759345:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032c0eb3b/0x1b294f297b1ed43f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.759357:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032c0eb3b/0x1b294f297b1ed43f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.759363:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032c0eb3b/0x1b294f297b1ed43f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.759380:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813278.759383:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813278.759384:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813278.760462:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813278.762012:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813278.762024:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d70ac82/0x1b294f297b1ed446 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.762040:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788813278.762044:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813278.762050:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d70ac82/0x1b294f297b1ed446 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.762064:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d70ac82/0x1b294f297b1ed446 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.762074:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d70ac82/0x1b294f297b1ed446 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.762082:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d70ac82/0x1b294f297b1ed446 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.762109:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813278.762141:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813278.762155:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d70ac82/0x1b294f297b1ed446 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.762169:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214da00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813278.762175:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d70ac82/0x1b294f297b1ed446 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.762188:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d70ac82/0x1b294f297b1ed446 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.762213:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d70ac82/0x1b294f297b1ed446 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.762230:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d70ac82/0x1b294f297b1ed446 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.762265:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813278.762268:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813278.762272:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788813278.765899:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788813278.767632:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813278.767649:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed44d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.767664:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788813278.767683:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813278.767690:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed44d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.767705:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed44d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.767728:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed44d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.767737:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed44d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.767770:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813278.767906:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813278.767920:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed44d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.767935:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214c000 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:2.0:1788813278.767943:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed44d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.767957:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed44d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.767987:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed44d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.767997:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035fa8099/0x1b294f297b1ed44d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813278.768029:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813278.768031:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813278.768033:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788813278.768548:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813278.768556:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000501f7a05/0x1b294f297b1ed454 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.768568:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1788813278.768573:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813278.768579:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000501f7a05/0x1b294f297b1ed454 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.768591:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000501f7a05/0x1b294f297b1ed454 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.768600:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000501f7a05/0x1b294f297b1ed454 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.768618:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000501f7a05/0x1b294f297b1ed454 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813278.768643:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813278.768674:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813278.768684:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000501f7a05/0x1b294f297b1ed454 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.768694:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214dc00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813278.768699:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000501f7a05/0x1b294f297b1ed454 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.768709:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000501f7a05/0x1b294f297b1ed454 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.768737:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000501f7a05/0x1b294f297b1ed454 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.768745:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000501f7a05/0x1b294f297b1ed454 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813278.768769:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813278.768772:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813278.768774:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788813278.768941:0:15044:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:3.0:1788813278.769051:0:15044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14382:x1875706322709120:12345-0@lo:5:osp-pre-0-0.0 Request processed in 67822us (67994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813278.769067:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788813278.769142:0:14382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36160380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14382:1875706322709120:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788813278.769172:0:14382:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1788813278.769240:0:14382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ecaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14382:1875706322709248:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788813278.769304:0:14382:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813278.769374:0:14382:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2253a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813278.769938:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322709248 00000100:00100000:3.0:1788813278.769949:0:15043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322709248 00000100:00100000:3.0:1788813278.770004:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788813278.770013:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36eca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14382:x1875706322709248:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788813278.770059:0:15043:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1788813278.775579:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36eca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14382:x1875706322709248:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5559us (6266us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788813278.775593:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788813278.775633:0:14382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ecaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14382:1875706322709248:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788813278.775656:0:14382:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1788813279.015309:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813280.028887:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813281.055087:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788813281.183749:0:15761:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788813281.183755:0:15761:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788813281.184247:0:15761:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93ef197e6000 00000020:01000004:3.0:1788813281.184267:0:15761:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788813281.184283:0:15761:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788813281.184320:0:15761:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93ee06994d40) 00000020:00000080:3.0:1788813281.184340:0:15761:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788813281.200138:0:15761:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788813281.200405:0:15761:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788813281.201308:0:15761:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788813281.201541:0:15761:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788813281.201887:0:15761:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788813281.202262:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 545: rc = 0 00100000:10000000:3.0:1788813281.202347:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 545: rc = 0 00100000:10000000:3.0:1788813281.202442:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 545: rc = 0 00100000:10000000:3.0:1788813281.203038:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 356: rc = 0 00100000:10000000:3.0:1788813281.203292:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 356: rc = 0 00100000:10000000:3.0:1788813281.203555:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 356: rc = 0 00100000:10000000:2.0:1788813281.204227:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 356: rc = 0 00100000:10000000:2.0:1788813281.204503:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 356: rc = 0 00100000:10000000:2.0:1788813281.204766:0:15761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 356: rc = 0 00000020:00000080:2.0:1788813281.205476:0:15761:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788813281.205492:0:15761:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788813281.205507:0:15761:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1b294f297b1ed462 00000020:01000004:2.0:1788813281.205517:0:15761:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788813281.205545:0:15761:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788813281.205549:0:15761:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788813281.205555:0:15761:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788813281.205582:0:15761:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788813281.205587:0:15761:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788813281.233734:0:15761:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788813281.233820:0:15761:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.113@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788813281.233825:0:15761:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788813281.233827:0:15761:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788813281.233829:0:15761:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813281.233830:0:15761:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813281.233832:0:15761:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813281.233833:0:15761:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813281.233835:0:15761:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788813281.233836:0:15761:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813281.233838:0:15761:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788813281.233842:0:15761:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788813281.233844:0:15761:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788813281.233845:0:15761:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788813281.233846:0:15761:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813281.233847:0:15761:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813281.233848:0:15761:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813281.233849:0:15761:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813281.233850:0:15761:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788813281.233852:0:15761:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813281.233853:0:15761:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788813281.233889:0:15761:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788813281.233915:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322709376:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788813281.234023:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813281.236329:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1bb43840 going to sleep for 11 seconds 00000100:00100000:2.0:1788813281.236477:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322709376 00000100:00100000:2.0:1788813281.236490:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322709376 00000100:00100000:2.0:1788813281.236695:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788813281.236718:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:15761:x1875706322709376:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788813281.236828:0:14352:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788813281.236832:0:14352:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788813281.236838:0:14352:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788813281.262914:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:15761:x1875706322709376:12345-0@lo:253:mount.lustre.0 Request processed in 26185us (28876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813281.262956:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788813281.263034:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322709376:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788813281.263076:0:15761:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788813281.263081:0:15761:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788813281.263083:0:15761:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788813281.263085:0:15761:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813281.263087:0:15761:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813281.263088:0:15761:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813281.263089:0:15761:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813281.263091:0:15761:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788813281.263110:0:15761:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813281.263112:0:15761:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788813281.263140:0:15761:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93ef197e6000 from lustre-OST0001 10000000:01000000:3.0:1788813281.263180:0:15761:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788813281.263183:0:15761:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788813281.263194:0:15761:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93ef12003380 local copy 00010000:00010000:3.0:1788813281.263208:0:15761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef190ce000/0x1b294f297b1ed208 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed20f expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813281.263527:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322709504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813281.263716:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813281.263920:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1bb43b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788813281.265016:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322709504 00000100:00100000:2.0:1788813281.265054:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322709504 00000100:00100000:2.0:1788813281.265241:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788813281.265254:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:15761:x1875706322709504:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813281.267060:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:15761:x1875706322709504:12345-0@lo:501:mount.lustre.0 Request processed in 1798us (3333us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788813281.267076:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788813281.268018:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322709504:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788813281.268053:0:15761:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788813281.268340:0:15761:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788813281.268353:0:15761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef190ce000/0x1b294f297b1ed208 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed20f expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813281.268366:0:15761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef190ce000/0x1b294f297b1ed208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed20f expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813281.268412:0:15761:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93ef197e6000 10000000:01000000:3.0:1788813281.268418:0:15761:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788813281.268426:0:15761:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788813281.268430:0:15761:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788813281.268436:0:15761:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788813281.268440:0:15761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788813281.268485:0:15761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214c800/0x1b294f297b1ed469 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813281.268494:0:15761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef4214c800/0x1b294f297b1ed469 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813281.268509:0:15761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef4214c800/0x1b294f297b1ed469 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813281.268534:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322709632:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788813281.268602:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813281.271179:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1bb43b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788813281.271995:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322709632 00000100:00100000:0.0:1788813281.272010:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322709632 00000100:00100000:0.0:1788813281.272113:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788813281.272126:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:15761:x1875706322709632:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813281.272147:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813281.272172:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef190cee00/0x1b294f297b1ed470 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ed469 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813281.272209:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef190cee00/0x1b294f297b1ed470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ed469 expref: 17 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813281.272222:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef190cee00/0x1b294f297b1ed470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed469 expref: 17 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813281.272234:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cee00, rc 0) 00000100:00100000:0.0:1788813281.272337:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+17:15761:x1875706322709632:12345-0@lo:101:mount.lustre.0 Request processed in 213us (3735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813281.272344:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788813281.272375:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322709632:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813281.272396:0:15761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef4214c800/0x1b294f297b1ed469 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed470 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813281.272409:0:15761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef4214c800/0x1b294f297b1ed469 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ed470 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788813281.273348:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788813281.274258:0:15761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788813281.274520:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788813281.274566:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788813281.274593:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788813281.274630:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788813281.274659:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788813281.274684:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788813281.274752:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788813281.274759:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788813281.274895:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322709760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813281.274971:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813281.275029:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1bb43540 going to sleep for 11 seconds 00000100:00100000:2.0:1788813281.275304:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322709760 00000100:00100000:2.0:1788813281.275313:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322709760 00000100:00100000:2.0:1788813281.275378:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788813281.275387:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+17:15761:x1875706322709760:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813281.275924:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+17:15761:x1875706322709760:12345-0@lo:501:mount.lustre.0 Request processed in 536us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813281.275933:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788813281.276998:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322709760:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813281.277070:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322709888:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813281.277151:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813281.277208:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2253ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788813281.277328:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322709888 00000100:00100000:2.0:1788813281.277335:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322709888 00000100:00100000:2.0:1788813281.277425:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788813281.277436:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+17:15761:x1875706322709888:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813281.277873:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+17:15761:x1875706322709888:12345-0@lo:503:mount.lustre.0 Request processed in 438us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813281.277882:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788813281.277981:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322709888:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788813281.279914:0:15761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788813281.280028:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322710016:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813281.280125:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813281.281885:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef10237240 going to sleep for 11 seconds 00000100:00100000:3.0:1788813281.282150:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322710016 00000100:00100000:3.0:1788813281.282163:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322710016 00000100:00100000:3.0:1788813281.282330:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788813281.282344:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+17:15761:x1875706322710016:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788813281.283077:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+17:15761:x1875706322710016:12345-0@lo:502:mount.lustre.0 Request processed in 734us (2950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813281.283088:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788813281.283287:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322710016:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788813281.283542:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788813281.283670:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788813281.283716:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788813281.283765:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788813281.283844:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788813281.283880:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788813281.283930:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788813281.283967:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788813281.284014:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788813281.284068:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322710144:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813281.284149:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813281.284204:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e30fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813281.284411:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322710144 00000100:00100000:2.0:1788813281.284420:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322710144 00000100:00100000:2.0:1788813281.284569:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788813281.284581:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+17:15761:x1875706322710144:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813281.284853:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+17:15761:x1875706322710144:12345-0@lo:502:mount.lustre.0 Request processed in 274us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813281.284862:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788813281.284951:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322710144:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788813281.285071:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788813281.285082:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788813281.286198:0:15763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788813281.286208:0:15763:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788813281.286216:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813281.286219:0:15763:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788813281.286226:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788813281.286248:0:15763:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93ef119e4d40) 00000020:00000080:1.0:1788813281.286280:0:15763:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788813281.286299:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788813281.286382:0:15763:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93ef197e6000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788813281.286391:0:15763:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788813281.286400:0:15763:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1b294f297b1ed47e 00010000:00010000:1.0:1788813281.291099:0:15763:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788813281.291743:0:15763:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1788813281.294433:0:15763:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788813281.296980:0:15763:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788813281.296997:0:15763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813281.297005:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813281.297008:0:15763:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788813281.297012:0:15763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813281.297017:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813281.297018:0:15763:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788813281.297021:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788813281.297024:0:15763:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788813281.297026:0:15763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813281.297029:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813281.297030:0:15763:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788813281.297032:0:15763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813281.297035:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813281.297036:0:15763:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788813281.297040:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788813281.297126:0:15763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813281.297130:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813281.297131:0:15763:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788813281.297135:0:15763:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788813281.297413:0:15761:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788813281.297453:0:15761:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788813281.297476:0:15761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214c800/0x1b294f297b1ed469 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed470 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813281.297490:0:15761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef4214c800/0x1b294f297b1ed469 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed470 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813281.297511:0:15761:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ef197e6000 from 1 10000000:01000000:2.0:1788813281.297514:0:15761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788813281.297562:0:15761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef21619600/0x1b294f297b1ed485 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813281.297571:0:15761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef21619600/0x1b294f297b1ed485 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813281.297585:0:15761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef21619600/0x1b294f297b1ed485 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813281.297616:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36162a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322710272:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788813281.297714:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813281.297771:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1a175480 going to sleep for 11 seconds 00000100:00100000:0.0:1788813281.297871:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322710272 00000100:00100000:0.0:1788813281.297881:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322710272 00000100:00100000:0.0:1788813281.297945:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788813281.297956:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+17:15761:x1875706322710272:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813281.297974:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813281.297990:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef190cfe00/0x1b294f297b1ed48c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ed485 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813281.298020:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef190cfe00/0x1b294f297b1ed48c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ed485 expref: 18 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813281.298033:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef190cfe00/0x1b294f297b1ed48c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed485 expref: 18 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813281.298042:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cfe00, rc 0) 00000100:00100000:0.0:1788813281.298091:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+18:15761:x1875706322710272:12345-0@lo:101:mount.lustre.0 Request processed in 137us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813281.298098:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788813281.298281:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36162a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322710272:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813281.298298:0:15761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef21619600/0x1b294f297b1ed485 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed48c expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813281.298308:0:15761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef21619600/0x1b294f297b1ed485 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ed48c expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788813281.298983:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788813281.299397:0:15761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788813281.299659:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788813281.299720:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788813281.299824:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788813281.299834:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788813281.299914:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36162a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322710400:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813281.300003:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813281.300058:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1a175480 going to sleep for 11 seconds 00000100:00100000:2.0:1788813281.300098:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322710400 00000100:00100000:2.0:1788813281.300107:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322710400 00000100:00100000:2.0:1788813281.300159:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788813281.300169:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+18:15761:x1875706322710400:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813281.300449:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+18:15761:x1875706322710400:12345-0@lo:501:mount.lustre.0 Request processed in 281us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813281.300457:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788813281.300508:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36162a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322710400:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813281.300542:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36162a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322710528:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813281.300584:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813281.300599:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1a175480 going to sleep for 11 seconds 00000100:00100000:2.0:1788813281.300612:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322710528 00000100:00100000:2.0:1788813281.300615:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322710528 00000100:00100000:2.0:1788813281.300633:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788813281.300639:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+18:15761:x1875706322710528:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813281.300972:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+18:15761:x1875706322710528:12345-0@lo:503:mount.lustre.0 Request processed in 332us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813281.300979:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788813281.301019:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36162a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322710528:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788813281.301522:0:15761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788813281.301598:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36162a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322710656:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813281.301644:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813281.301666:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1a175480 going to sleep for 11 seconds 00000100:00100000:2.0:1788813281.301694:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322710656 00000100:00100000:2.0:1788813281.308433:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322710656 00000100:00100000:3.0:1788813281.308748:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788813281.308761:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+18:15761:x1875706322710656:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788813281.309999:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+18:15761:x1875706322710656:12345-0@lo:502:mount.lustre.0 Request processed in 1231us (8344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813281.310013:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788813281.310420:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36162a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322710656:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788813281.311206:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788813281.311294:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788813281.311393:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788813281.311433:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788813281.311468:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788813281.311515:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788813281.311548:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788813281.311582:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788813281.311637:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36162a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322710784:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813281.311730:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813281.312080:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef1a175480 going to sleep for 11 seconds 00000100:00100000:0.0:1788813281.312184:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322710784 00000100:00100000:0.0:1788813281.312195:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322710784 00000100:00100000:0.0:1788813281.312267:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788813281.312279:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ba9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+18:15761:x1875706322710784:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813281.312560:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ba9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+18:15761:x1875706322710784:12345-0@lo:502:mount.lustre.0 Request processed in 272us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813281.312569:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788813281.314520:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36162a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322710784:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788813281.314772:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788813281.314811:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788813281.318816:0:15767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813281.318867:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813281.318876:0:15767:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788813281.318885:0:15767:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93ef197e6000 00000020:00000080:3.0:1788813281.318889:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788813281.318898:0:15767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813281.318901:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813281.318903:0:15767:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788813281.318905:0:15767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813281.318907:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813281.318909:0:15767:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788813281.318912:0:15767:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93ef197e6000 00000020:00000080:3.0:1788813281.318914:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788813281.324242:0:15767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813281.324267:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813281.324270:0:15767:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788813281.324275:0:15767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813281.324280:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813281.324282:0:15767:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788813281.324287:0:15767:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93ef197e6000 00000020:00000080:3.0:1788813281.324290:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788813281.324436:0:15767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813281.324440:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813281.324442:0:15767:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788813281.324445:0:15767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788813281.324658:0:15761:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788813281.324720:0:15761:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788813281.324751:0:15761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef21619600/0x1b294f297b1ed485 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed48c expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813281.324767:0:15761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef21619600/0x1b294f297b1ed485 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed48c expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813281.324862:0:15761:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788813281.324866:0:15761:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93ef197e6000 10000000:01000000:0.0:1788813281.324870:0:15761:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93ef197e6000 10000000:01000000:0.0:1788813281.324876:0:15761:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788813281.324883:0:15761:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93ef197e6000 from 1 10000000:01000000:0.0:1788813281.324887:0:15761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788813281.324935:0:15761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef190cf000/0x1b294f297b1ed493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813281.324945:0:15761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef190cf000/0x1b294f297b1ed493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813281.324958:0:15761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef190cf000/0x1b294f297b1ed493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813281.324988:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322710912:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788813281.325069:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813281.325116:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2253a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813281.325747:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322710912 00000100:00100000:3.0:1788813281.325758:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322710912 00000100:00100000:3.0:1788813281.325834:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788813281.325844:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ba8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+18:15761:x1875706322710912:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813281.325862:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813281.325878:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef4214c400/0x1b294f297b1ed49a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ed493 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813281.325908:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef4214c400/0x1b294f297b1ed49a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ed493 expref: 19 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813281.325927:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef4214c400/0x1b294f297b1ed49a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed493 expref: 19 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813281.325937:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef4214c400, rc 0) 00000100:00100000:3.0:1788813281.325997:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ba8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:15761:x1875706322710912:12345-0@lo:101:mount.lustre.0 Request processed in 155us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813281.326004:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788813281.328721:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322710912:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813281.328760:0:15761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef190cf000/0x1b294f297b1ed493 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed49a expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813281.328777:0:15761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef190cf000/0x1b294f297b1ed493 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ed49a expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788813281.329546:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788813281.330002:0:15761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813281.330261:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788813281.330301:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788813281.330331:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788813281.330379:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788813281.330412:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788813281.330457:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788813281.330493:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788813281.330525:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788813281.330573:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788813281.330608:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788813281.330640:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788813281.330682:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788813281.330750:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788813281.330822:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788813281.330875:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788813281.330910:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788813281.330943:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788813281.330989:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788813281.331026:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788813281.331058:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788813281.331105:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788813281.331138:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788813281.331171:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788813281.331215:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788813281.331249:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788813281.331282:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788813281.331326:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788813281.331361:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788813281.331411:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788813281.331470:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1788813281.331507:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1788813281.331538:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1788813281.331572:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1788813281.331618:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1788813281.331655:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1788813281.336403:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1788813281.337921:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1788813281.338095:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1788813281.338103:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788813281.338244:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322711040:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813281.338330:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813281.338382:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2253a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813281.338604:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322711040 00000100:00100000:2.0:1788813281.338614:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322711040 00000100:00100000:2.0:1788813281.338672:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788813281.338682:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36baa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:15761:x1875706322711040:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813281.339018:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36baa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:15761:x1875706322711040:12345-0@lo:501:mount.lustre.0 Request processed in 337us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813281.339027:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788813281.339229:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322711040:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813281.339274:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322711168:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813281.339319:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813281.339351:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef2253a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813281.339721:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322711168 00000100:00100000:2.0:1788813281.339729:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322711168 00000100:00100000:2.0:1788813281.339770:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788813281.339778:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36bab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:15761:x1875706322711168:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813281.340186:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36bab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:15761:x1875706322711168:12345-0@lo:503:mount.lustre.0 Request processed in 406us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813281.340196:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788813281.340520:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322711168:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788813281.341544:0:15761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788813281.341649:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322711296:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813281.341739:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813281.341826:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e30fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813281.342941:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322711296 00000100:00100000:2.0:1788813281.342955:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322711296 00000100:00100000:2.0:1788813281.343034:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788813281.343046:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ba8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:15761:x1875706322711296:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813281.343484:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ba8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:15761:x1875706322711296:12345-0@lo:502:mount.lustre.0 Request processed in 437us (1742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813281.343492:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788813281.343862:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322711296:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788813281.345838:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788813281.345989:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788813281.346023:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788813281.346081:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788813281.346119:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788813281.346168:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788813281.346212:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788813281.346242:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788813281.348170:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788813281.348719:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788813281.352831:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788813281.352956:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788813281.353002:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788813281.353032:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788813281.353077:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788813281.353112:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788813281.353140:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788813281.355151:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788813281.359812:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788813281.359896:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788813281.360019:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788813281.360074:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788813281.360140:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788813281.362145:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788813281.362288:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788813281.362341:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788813281.362467:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788813281.362521:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788813281.362566:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788813281.362616:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788813281.362663:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788813281.362706:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788813281.362744:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788813281.362824:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788813281.362860:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788813281.362909:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788813281.362945:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788813281.362992:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788813281.363065:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788813281.363121:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788813281.363192:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322711424:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813281.363306:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813281.363372:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e30fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813281.368490:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322711424 00000100:00100000:0.0:1788813281.368525:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322711424 00000100:00100000:0.0:1788813281.368618:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788813281.368632:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36960850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:15761:x1875706322711424:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813281.369100:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36960850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:15761:x1875706322711424:12345-0@lo:502:mount.lustre.0 Request processed in 470us (5793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813281.369109:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788813281.369258:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322711424:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788813281.369404:0:15761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788813281.369425:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788813281.372579:0:15772:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788813281.372623:0:15772:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93ee010fb380) 00000020:00000080:2.0:1788813281.372652:0:15772:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788813281.372760:0:15772:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93ef197e6000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788813281.372766:0:15772:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93ef197e6000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788813281.372768:0:15772:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93ef197e6000 3 00010000:00080000:2.0:1788813281.373585:0:15772:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93ee06c23000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1788813281.384078:0:15772:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1788813281.385943:0:15772:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788813281.386003:0:15772:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788813281.386024:0:15772:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1b294f297b1ed4a8 00000100:00080000:1.0:1788813281.386040:0:15772:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788813281.386059:0:15772:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93ee06c23000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1788813281.386109:0:15772:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ef37fb6d80 x1875706322711552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788813281.386157:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1875706322711552:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788813281.386270:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813281.389578:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322711552 00000100:00100000:2.0:1788813281.389600:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322711552 00000100:00100000:2.0:1788813281.389683:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788813281.389694:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1875706322711552:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788813281.389741:0:14359:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:2.0:1788813281.389819:0:14359:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1b294f297b1ed4af 00000004:00100000:2.0:1788813281.389843:0:14359:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788813281.389892:0:14359:0:(import.c:65:import_set_state_nolock()) ffff93ee06c27800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788813281.390022:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875706322711552:12345-0@lo:38:llog_process_th.0 Request processed in 329us (3752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813281.390030:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788813281.390533:0:15772:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00010000:00080000:0.0:1788813281.390604:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef37fb6d80 x1875706322711552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788813281.390613:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813281.390620:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:0.0:1788813281.390621:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788813281.390624:0:8:0:(import.c:65:import_set_state_nolock()) ffff93ef3ad93000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813281.390631:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 439 00000100:00080000:0.0:1788813281.390634:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788813281.390645:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788813281.390651:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788813281.390654:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788813281.390655:0:3298:0:(import.c:65:import_set_state_nolock()) ffff93ee06c23000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788813281.390666:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1875706322711552:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788813281.390669:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93ef3ad93000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1788813281.390694:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ef37fb7b80 x1875706322711808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788813281.390731:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1875706322711808:0@lo:8:kworker.0 00000100:00100000:1.0:1788813281.390767:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813281.390795:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1875706322712064:0@lo:400:kworker.0 00000100:00100000:1.0:1788813281.390839:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813281.391408:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813281.393059:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322712064 00000100:00100000:3.0:1788813281.393079:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322712064 00000100:00100000:1.0:1788813281.393244:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322711808 00000100:00100000:1.0:1788813281.393257:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322711808 00000100:00100000:1.0:1788813281.393298:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813281.393309:0:15044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3298:x1875706322711808:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788813281.393452:0:15044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3298:x1875706322711808:12345-0@lo:8:kworker.0 Request processed in 144us (2044us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788813281.393459:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813281.393521:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788813281.393531:0:3298:0:(import.c:65:import_set_state_nolock()) ffff93ef3ad93000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788813281.393536:0:3298:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788813281.393540:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1875706322711808:0@lo:8:kworker.0 00000040:00080000:1.0:1788813281.393808:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788813281.393902:0:15761:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788813281.393945:0:15761:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788813281.393964:0:15761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef190cf000/0x1b294f297b1ed493 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed49a expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813281.393977:0:15761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef190cf000/0x1b294f297b1ed493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed49a expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788813281.394060:0:15761:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788813281.394063:0:15761:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788813281.394065:0:15761:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813281.394066:0:15761:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788813281.394068:0:15761:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813281.394070:0:15761:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813281.394072:0:15761:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788813281.394075:0:15761:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813281.394076:0:15761:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788813281.394082:0:15761:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788813281.394085:0:15761:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788813281.394086:0:15761:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788813281.394088:0:15761:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813281.394090:0:15761:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788813281.394091:0:15761:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813281.394093:0:15761:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813281.394094:0:15761:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788813281.394095:0:15761:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813281.394096:0:15761:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788813281.394125:0:15761:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788813281.394147:0:15761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322712192:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788813281.394210:0:15761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813281.394252:0:15761:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e30f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813281.394282:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322712192 00000100:00100000:1.0:1788813281.394288:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322712192 00000100:00100000:1.0:1788813281.394327:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788813281.394336:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36963050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:15761:x1875706322712192:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788813281.394378:0:14354:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788813281.394396:0:14354:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788813281.396552:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788813281.396574:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875706322712064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813281.396695:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875706322712064:12345-0@lo:400:kworker.0 Request processed in 129us (5855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813281.396713:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788813281.396744:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788813281.396869:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef37fb5880 x1875706322712064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813281.396889:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1875706322712064:0@lo:400:kworker.0 00000100:00100000:3.0:1788813281.397018:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875706322711936:0@lo:400:kworker.0 00000100:00100000:3.0:1788813281.397065:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813281.397103:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788813281.397111:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322711680:0@lo:400:kworker.0 00000100:00100000:3.0:1788813281.397138:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813281.397170:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322711680 00000100:00100000:1.0:1788813281.397381:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322711936 00000100:00100000:1.0:1788813281.397387:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322711936 00000100:00100000:1.0:1788813281.397427:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788813281.397434:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875706322711936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813281.397482:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875706322711936:12345-0@lo:400:kworker.0 Request processed in 48us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813281.397488:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788813281.397516:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93ef37fb6a00 x1875706322711936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813281.397525:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875706322711936:0@lo:400:kworker.0 00000100:00100000:3.0:1788813281.397614:0:15043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322711680 00000100:00100000:3.0:1788813281.397669:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788813281.397676:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3302:x1875706322711680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813281.397725:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3302:x1875706322711680:12345-0@lo:400:kworker.0 Request processed in 51us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813281.397743:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788813281.397866:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813281.397902:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322711680:0@lo:400:kworker.0 20000000:01000000:2.0:1788813281.496634:0:14354:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788813281.496660:0:14354:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788813281.496765:0:14375:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788813281.496771:0:14375:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788813281.496832:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ef4214c000/0x1b294f297b1ed4b6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813281.496857:0:14375:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef354fd800/0x1b294f297b1ed389 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed382 expref: 19 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813281.496869:0:14375:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ef4214c000/0x1b294f297b1ed4b6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813281.496932:0:14375:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef354fd800/0x1b294f297b1ed389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ed382 expref: 19 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813281.496949:0:14375:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ef354fd800/0x1b294f297b1ed389 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ed382 expref: 19 pid: 14353 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813281.496966:0:14375:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14375:1875706322712320:0@lo:104: 00000100:00100000:3.0:1788813281.497050:0:14375:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813281.497118:0:14375:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee066bb900 going to sleep for 11 seconds 00000100:00100000:1.0:1788813281.497437:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322712320 00000100:00100000:1.0:1788813281.497448:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322712320 00000100:00100000:1.0:1788813281.497537:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813281.497549:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+3:14375:x1875706322712320:12345-0@lo:104: 00010000:00010000:1.0:1788813281.497568:0:14343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef01516800/0x1b294f297b1ed382 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ed389 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813281.497633:0:14343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788813281.497639:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+3:14375:x1875706322712320:12345-0@lo:104: Request processed in 92us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813281.497646:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788813281.498467:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813281.498479:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef01516800/0x1b294f297b1ed382 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ed389 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813281.498511:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef01516800 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:1.0:1788813281.498516:0:14347:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef01516800/0x1b294f297b1ed382 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ed389 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813281.498526:0:14347:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef01516800/0x1b294f297b1ed382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ed389 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813281.498534:0:14347:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef01516800/0x1b294f297b1ed382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ed389 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813281.498541:0:14347:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788813281.498980:0:14347:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef01516800/0x1b294f297b1ed382 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ed389 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813281.498990:0:14347:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813281.499029:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef01516800/0x1b294f297b1ed382 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ed389 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813281.499037:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef01516800/0x1b294f297b1ed382 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ed389 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813281.499065:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813281.499067:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813281.499069:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813281.499082:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3300:1875706322712448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813281.499109:0:14375:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14375:1875706322712320:0@lo:104: 00000100:00100000:2.0:1788813281.499164:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813281.499268:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322712448 00000100:00100000:2.0:1788813281.499276:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322712448 00010000:00010000:2.0:1788813281.499303:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef354fd800/0x1b294f297b1ed389 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ed382 expref: 20 pid: 14353 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813281.499335:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788813281.499344:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36163100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+20:3300:x1875706322712448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813281.499357:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813281.499364:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef354fd800/0x1b294f297b1ed389 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ed382 expref: 20 pid: 14353 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813281.499377:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef354fd800/0x1b294f297b1ed389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ed382 expref: 20 pid: 14353 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813281.499392:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef354fd800/0x1b294f297b1ed389 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ed382 expref: 20 pid: 14353 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813281.499408:0:14345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ef4214c000/0x1b294f297b1ed4b6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813281.499418:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef4214c000/0x1b294f297b1ed4b6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788813281.499437:0:14345:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003235640s 00010000:00010000:2.0:1788813281.499441:0:14345:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ef4214c000/0x1b294f297b1ed4b6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813281.499449:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ef4214c000/0x1b294f297b1ed4b6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813281.499466:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ef4214c000/0x1b294f297b1ed4b6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813281.499478:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ef4214c000/0x1b294f297b1ed4b6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813281.499483:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214c000 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:2.0:1788813281.499488:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ef4214c000/0x1b294f297b1ed4b6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813281.499497:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ef4214c000/0x1b294f297b1ed4b6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813281.499508:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ef4214c000/0x1b294f297b1ed4b6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813281.499518:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813281.499554:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36163100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:3300:x1875706322712448:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813281.499562:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788813281.499598:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3300:1875706322712448:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813281.499992:0:14375:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ef4214c000/0x1b294f297b1ed4b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813281.500003:0:14375:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ef4214c000/0x1b294f297b1ed4b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813281.500017:0:14375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ef4214c000/0x1b294f297b1ed4b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813281.500024:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef4214c000/0x1b294f297b1ed4b6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813281.512610:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36963050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+18:15761:x1875706322712192:12345-0@lo:253:mount.lustre.0 Request processed in 118206us (118331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813281.512628:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788813281.512963:0:15761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:15761:1875706322712192:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788813281.512983:0:15761:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788813281.512988:0:15761:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788813281.512989:0:15761:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788813281.512992:0:15761:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813281.512993:0:15761:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788813281.512994:0:15761:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813281.512996:0:15761:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813281.512997:0:15761:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788813281.512999:0:15761:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813281.513000:0:15761:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788813281.513017:0:15761:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788813281.518263:0:15761:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788813281.518461:0:15761:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788813281.518605:0:15761:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788813281.518762:0:15761:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788813281.519010:0:15761:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788813281.519235:0:15761:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788813281.520115:0:15761:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788813281.637096:0:15761:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788813281.637106:0:15761:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788813281.639905:0:15761:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788813281.640008:0:15761:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788813281.640031:0:15761:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788813281.640078:0:15761:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788813282.078124:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813283.102212:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788813283.104737:0:6700:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788813283.104752:0:6700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 10000000:01000000:3.0:1788813283.164857:0:14357:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788813283.164865:0:14357:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93ef36653800 from 8 10000000:01000000:3.0:1788813283.164871:0:14357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788813283.164915:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214dc00/0x1b294f297b1ed4bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813283.164938:0:14357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef4214dc00/0x1b294f297b1ed4bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813283.164950:0:14357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef4214dc00/0x1b294f297b1ed4bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813283.164977:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322712576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788813283.165042:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813283.165101:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef211caa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813283.165236:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322712576 00000100:00100000:0.0:1788813283.165245:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322712576 00000100:00100000:0.0:1788813283.165308:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788813283.165318:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36960050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+18:14357:x1875706322712576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813283.165330:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813283.165344:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef190cf400/0x1b294f297b1ed4c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ed4bd expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813283.165370:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef190cf400/0x1b294f297b1ed4c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ed4bd expref: 19 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813283.165381:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef190cf400/0x1b294f297b1ed4c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed4bd expref: 19 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813283.165390:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cf400, rc 0) 00000100:00100000:0.0:1788813283.165440:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36960050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:14357:x1875706322712576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813283.165457:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788813283.165555:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322712576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813283.165570:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef4214dc00/0x1b294f297b1ed4bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed4c4 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813283.165579:0:14357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef4214dc00/0x1b294f297b1ed4bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ed4c4 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813283.165626:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322712704:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788813283.165659:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813283.165696:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef211caa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813283.165751:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322712704 00000100:00100000:0.0:1788813283.165755:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322712704 00000100:00100000:0.0:1788813283.165801:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788813283.165809:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36962850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:14357:x1875706322712704:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788813283.165820:0:14354:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788813283.165834:0:14354:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788813283.165837:0:14354:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788813283.165917:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36962850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:14357:x1875706322712704:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813283.165924:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788813283.165953:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322712704:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788813283.166005:0:14357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788813283.166012:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef4214dc00/0x1b294f297b1ed4bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed4c4 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813283.166019:0:14357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef4214dc00/0x1b294f297b1ed4bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed4c4 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813283.997225:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813283.997251:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322712832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813283.997331:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813283.997504:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322712832 00000100:00100000:3.0:1788813283.997518:0:15046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322712832 00000100:00100000:3.0:1788813283.997592:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788813283.997601:0:15046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322712832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813283.997634:0:15046:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813283.997693:0:15046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322712832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813283.997716:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788813283.997968:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813283.998042:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788813283.998066:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322712832:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788813284.124868:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813285.149061:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788813285.408505:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788813286.174331:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788813286.561125:0:1248:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813286.561132:0:1248:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788813286.561136:0:1248:0:(import.c:65:import_set_state_nolock()) ffff93ef3ad93000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1788813286.561141:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3302:1875706322712960:0@lo:400:kworker.0 00000100:00080000:3.0:1788813286.561163:0:1248:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93ef3ad93000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788813286.561187:0:1248:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93ef3ae78380 x1875706322713216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788813286.561213:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813286.561269:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813286.561275:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1875706322713472:0@lo:400:kworker.0 00000100:00100000:1.0:1788813286.561299:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813286.561326:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322712960 00000100:00100000:1.0:1788813286.561341:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322712960 00000100:00100000:3.0:1788813286.561374:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813286.561385:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322713600:0@lo:400:kworker.0 00000100:00100000:1.0:1788813286.561392:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788813286.561403:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36961850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:3302:x1875706322712960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813286.561423:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813286.561456:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322713088:0@lo:400:kworker.0 00000100:00100000:1.0:1788813286.561464:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36961850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:3302:x1875706322712960:12345-0@lo:400:kworker.0 Request processed in 60us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813286.561473:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788813286.561489:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813286.561508:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322713472 00000100:00100000:3.0:1788813286.561513:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788813286.561514:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322713472 00000100:00100000:3.0:1788813286.561522:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322713344:0@lo:400:kworker.0 00000100:00100000:3.0:1788813286.561546:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813286.564600:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1875706322713216:0@lo:8:kworker.0 00000100:00100000:3.0:1788813286.564658:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813286.565864:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322713088 00000100:00100000:2.0:1788813286.565875:0:15045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322713088 00000100:00100000:2.0:1788813286.565913:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322713216 00000100:00100000:2.0:1788813286.565916:0:15045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322713216 00000100:00100000:2.0:1788813286.565928:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813286.565939:0:15045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322713088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813286.566001:0:15045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322713088:12345-0@lo:400:kworker.0 Request processed in 66us (4512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813286.566007:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813286.566023:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788813286.566027:0:15045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3298:x1875706322713216:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788813286.566049:0:15045:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:2.0:1788813286.566076:0:15045:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1b294f297b1ed4cb 00002000:00100000:2.0:1788813286.566088:0:15045:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93ee049f0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788813286.566092:0:15045:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788813286.566094:0:15045:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788813286.566438:0:15045:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788813286.566461:0:15045:0:(import.c:65:import_set_state_nolock()) ffff93ee049f0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788813286.566505:0:15045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3298:x1875706322713216:12345-0@lo:8:kworker.0 Request processed in 476us (1846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813286.566512:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788813286.566557:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3302:1875706322712960:0@lo:400:kworker.0 00000100:00100000:1.0:1788813286.566971:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322713600 00000100:00100000:3.0:1788813286.566973:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322713344 00000100:00100000:1.0:1788813286.566978:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322713600 00000100:00100000:3.0:1788813286.566980:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322713344 00000100:00100000:3.0:1788813286.567022:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788813286.567037:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875706322713472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813286.567171:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875706322713472:12345-0@lo:400:kworker.0 Request processed in 141us (5870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813286.567208:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788813286.567217:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322713344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813286.567255:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322713344:12345-0@lo:400:kworker.0 Request processed in 40us (5709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813286.567261:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788813286.567272:0:14360:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788813286.567279:0:14360:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788813286.567289:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788813286.567309:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788813286.567316:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875706322713600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813286.567354:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875706322713600:12345-0@lo:400:kworker.0 Request processed in 40us (5932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813286.567360:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788813286.567420:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef3ae7b800 x1875706322713344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813286.567431:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322713344:0@lo:400:kworker.0 00000100:00100000:3.0:1788813286.567442:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322713088:0@lo:400:kworker.0 00010000:00080000:3.0:1788813286.567469:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef3ae78380 x1875706322713216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788813311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788813286.567480:0:3298:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788813286.567487:0:3298:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788813286.567492:0:3298:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788813286.567494:0:3298:0:(import.c:65:import_set_state_nolock()) ffff93ef3ad93000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788813286.567516:0:3298:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788813286.567521:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1875706322713216:0@lo:8:kworker.0 00000004:00080000:1.0:1788813286.567527:0:14383:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:3.0:1788813286.567548:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef3ae7bb80 x1875706322713600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813286.567557:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322713600:0@lo:400:kworker.0 00000100:00080000:0.0:1788813286.567614:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788813286.567620:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788813286.567712:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef3ae7b100 x1875706322713472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813286.567722:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1875706322713472:0@lo:400:kworker.0 00000004:00080000:3.0:1788813286.568384:0:14384:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1788813286.568404:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14384:1875706322713856:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788813286.568452:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813286.568479:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee01093d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813286.568494:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322713728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813286.568521:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813286.568557:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322713728 00000100:00100000:3.0:1788813286.568562:0:15046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322713728 00000100:00100000:3.0:1788813286.568607:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788813286.568617:0:15046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1875706322713728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813286.568643:0:15046:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813286.568695:0:15046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1875706322713728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813286.568701:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788813286.568717:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788813286.568739:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93ef3ae7bb80 x1875706322713728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813286.568754:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322713728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813286.568771:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322713856 00000100:00100000:3.0:1788813286.568775:0:15045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322713856 00000100:00100000:3.0:1788813286.568860:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788813286.568867:0:15045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14384:x1875706322713856:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788813286.569480:0:14383:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 446955697459ns, next at 0ns, rc = 0 00002000:00080000:3.0:1788813286.575550:0:15045:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788813286.575562:0:15045:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788813286.575567:0:15045:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:2.0:1788813286.597528:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813286.597542:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023275aec/0x1b294f297b1ed4d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.597560:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1788813286.597565:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.597571:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023275aec/0x1b294f297b1ed4d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.597589:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023275aec/0x1b294f297b1ed4d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.597601:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023275aec/0x1b294f297b1ed4d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.597608:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023275aec/0x1b294f297b1ed4d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.597635:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788813286.598157:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813286.598165:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1ed4d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.598176:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1788813286.598179:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.598184:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1ed4d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.598194:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1ed4d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.598202:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1ed4d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.598208:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1ed4d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.598391:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788813286.598549:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788813286.598557:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023275aec/0x1b294f297b1ed4d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.598577:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618c00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813286.598582:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023275aec/0x1b294f297b1ed4d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.598592:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023275aec/0x1b294f297b1ed4d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.598611:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023275aec/0x1b294f297b1ed4d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.598618:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023275aec/0x1b294f297b1ed4d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.598639:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813286.598643:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1ed4d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.598649:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618000 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813286.598652:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1ed4d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.598660:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1ed4d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.598680:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1ed4d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.598694:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1ed4d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.598708:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813286.598710:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813286.598712:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813286.599531:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813286.602074:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813286.602088:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1ed4e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.602104:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1788813286.602115:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.602122:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1ed4e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.602138:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1ed4e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.602149:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1ed4e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.602157:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1ed4e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.602175:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813286.603103:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813286.603118:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1ed4e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.603130:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619c00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813286.603135:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1ed4e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788813286.603305:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813286.603312:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9c934d2/0x1b294f297b1ed4e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.603322:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1788813286.603326:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.603332:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9c934d2/0x1b294f297b1ed4e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.603343:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9c934d2/0x1b294f297b1ed4e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.603353:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9c934d2/0x1b294f297b1ed4e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.603436:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9c934d2/0x1b294f297b1ed4e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.603455:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813286.603466:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813286.603973:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1ed4e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.603991:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1ed4e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.603998:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1ed4e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.604103:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813286.604105:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813286.604113:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813286.604228:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813286.604234:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001496022d/0x1b294f297b1ed4ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.604243:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1788813286.604246:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.604251:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001496022d/0x1b294f297b1ed4ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.604259:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001496022d/0x1b294f297b1ed4ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.604268:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001496022d/0x1b294f297b1ed4ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.604275:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001496022d/0x1b294f297b1ed4ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.604294:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813286.604422:0:16048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813286.604428:0:16048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001496022d/0x1b294f297b1ed4ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.604436:0:16048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619000 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813286.604446:0:16048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001496022d/0x1b294f297b1ed4ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.604455:0:16048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001496022d/0x1b294f297b1ed4ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.604468:0:16048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001496022d/0x1b294f297b1ed4ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.604476:0:16048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001496022d/0x1b294f297b1ed4ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.604494:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9c934d2/0x1b294f297b1ed4e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.604500:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619400 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813286.604504:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9c934d2/0x1b294f297b1ed4e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.604511:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9c934d2/0x1b294f297b1ed4e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.604521:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9c934d2/0x1b294f297b1ed4e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.604528:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9c934d2/0x1b294f297b1ed4e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.604551:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813286.604553:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813286.604555:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813286.604561:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813286.604562:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813286.604564:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813286.604674:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813286.604941:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813286.604946:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b051a2b0/0x1b294f297b1ed4f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.604961:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1788813286.604964:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.604968:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b051a2b0/0x1b294f297b1ed4f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.604978:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b051a2b0/0x1b294f297b1ed4f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.604987:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b051a2b0/0x1b294f297b1ed4f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.604995:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b051a2b0/0x1b294f297b1ed4f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.605007:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813286.605015:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813286.605019:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b051a2b0/0x1b294f297b1ed4f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.605026:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618600 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:2.0:1788813286.605029:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b051a2b0/0x1b294f297b1ed4f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.605037:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b051a2b0/0x1b294f297b1ed4f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.605060:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b051a2b0/0x1b294f297b1ed4f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.605067:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b051a2b0/0x1b294f297b1ed4f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.605085:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813286.605088:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813286.605090:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813286.606057:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813286.606065:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed4fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.606076:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1788813286.606080:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.606085:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed4fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.606095:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed4fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.606104:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed4fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.606112:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed4fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.606138:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813286.607825:0:16048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813286.607836:0:16048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed4fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.607847:0:16048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619a00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813286.607851:0:16048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed4fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.607861:0:16048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed4fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.607880:0:16048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed4fc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.607887:0:16048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed4fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.607906:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813286.607908:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813286.607909:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813286.607918:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813286.607925:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e1f366b/0x1b294f297b1ed503 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.607935:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1788813286.607939:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.607944:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e1f366b/0x1b294f297b1ed503 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.607955:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e1f366b/0x1b294f297b1ed503 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.607965:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e1f366b/0x1b294f297b1ed503 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.607972:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e1f366b/0x1b294f297b1ed503 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.607987:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813286.607996:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813286.608000:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e1f366b/0x1b294f297b1ed503 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.608008:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618800 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:2.0:1788813286.608018:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e1f366b/0x1b294f297b1ed503 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.608026:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e1f366b/0x1b294f297b1ed503 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.608037:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e1f366b/0x1b294f297b1ed503 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.608045:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e1f366b/0x1b294f297b1ed503 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.608060:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813286.608062:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813286.608063:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788813286.608436:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1788813286.608526:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813286.608532:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cae5a59/0x1b294f297b1ed50a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.608541:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1788813286.608545:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.608549:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cae5a59/0x1b294f297b1ed50a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.608559:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cae5a59/0x1b294f297b1ed50a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.608578:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cae5a59/0x1b294f297b1ed50a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.608585:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cae5a59/0x1b294f297b1ed50a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.609040:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813286.609320:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813286.609326:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cae5a59/0x1b294f297b1ed50a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.609335:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619800 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813286.609339:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cae5a59/0x1b294f297b1ed50a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.609348:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cae5a59/0x1b294f297b1ed50a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.609361:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cae5a59/0x1b294f297b1ed50a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.609368:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cae5a59/0x1b294f297b1ed50a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.609386:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813286.609388:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813286.609389:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813286.609548:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813286.609554:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009dcc6686/0x1b294f297b1ed511 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.609563:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1788813286.609567:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.609572:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dcc6686/0x1b294f297b1ed511 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.609582:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009dcc6686/0x1b294f297b1ed511 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.609590:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009dcc6686/0x1b294f297b1ed511 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.609598:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009dcc6686/0x1b294f297b1ed511 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.609633:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813286.609679:0:16048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813286.609684:0:16048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009dcc6686/0x1b294f297b1ed511 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.609692:0:16048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618200 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813286.609695:0:16048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009dcc6686/0x1b294f297b1ed511 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.609713:0:16048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009dcc6686/0x1b294f297b1ed511 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.609725:0:16048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009dcc6686/0x1b294f297b1ed511 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.609731:0:16048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009dcc6686/0x1b294f297b1ed511 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.609747:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813286.609748:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813286.609751:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813286.610185:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813286.610192:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed518 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.610202:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1788813286.610205:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.610210:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed518 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.610219:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed518 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.610227:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed518 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.610235:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed518 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.610258:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813286.610337:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813286.610344:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed518 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.610352:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619200 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813286.610355:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed518 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.610364:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed518 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.610375:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed518 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.610382:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed518 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.610397:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813286.610398:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813286.610400:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813286.610644:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813286.610650:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc831f7/0x1b294f297b1ed51f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.610658:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1788813286.610680:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.610684:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc831f7/0x1b294f297b1ed51f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.610694:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdc831f7/0x1b294f297b1ed51f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.610703:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc831f7/0x1b294f297b1ed51f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.610930:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc831f7/0x1b294f297b1ed51f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.610954:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813286.611200:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813286.611210:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdc831f7/0x1b294f297b1ed51f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.611217:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618400 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813286.611221:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc831f7/0x1b294f297b1ed51f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.611305:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc831f7/0x1b294f297b1ed51f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.611319:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdc831f7/0x1b294f297b1ed51f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.611336:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdc831f7/0x1b294f297b1ed51f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.611351:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813286.611353:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813286.611354:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813286.611356:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813286.611361:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1ed526 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.611370:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1788813286.611373:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.611377:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1ed526 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.611386:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1ed526 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.611393:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1ed526 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.611406:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1ed526 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.611426:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813286.611443:0:16048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813286.611448:0:16048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1ed526 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.611456:0:16048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618000 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813286.611459:0:16048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1ed526 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.611467:0:16048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1ed526 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.611478:0:16048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1ed526 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.611485:0:16048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062d3dbca/0x1b294f297b1ed526 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.611497:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813286.611498:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813286.611500:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813286.612149:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813286.612157:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023275aec/0x1b294f297b1ed52d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.612167:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1788813286.612169:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.612173:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023275aec/0x1b294f297b1ed52d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.612182:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023275aec/0x1b294f297b1ed52d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.612189:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023275aec/0x1b294f297b1ed52d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.612195:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023275aec/0x1b294f297b1ed52d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.612216:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813286.612582:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813286.612588:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023275aec/0x1b294f297b1ed52d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.612596:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618c00 already unused, calling callback (ffffffffc14548b0) 00002000:00010000:2.0:1788813286.612597:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813286.612600:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023275aec/0x1b294f297b1ed52d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.612602:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a91252f2/0x1b294f297b1ed534 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.612616:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=446s v=(0 0) 00010000:00010000:3.0:1788813286.612619:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023275aec/0x1b294f297b1ed52d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.612619:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.612624:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a91252f2/0x1b294f297b1ed534 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.612633:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023275aec/0x1b294f297b1ed52d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.612633:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a91252f2/0x1b294f297b1ed534 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.612641:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023275aec/0x1b294f297b1ed52d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.612642:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a91252f2/0x1b294f297b1ed534 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.612648:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a91252f2/0x1b294f297b1ed534 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.612676:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813286.612680:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a91252f2/0x1b294f297b1ed534 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.612687:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef01516800 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813286.612690:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a91252f2/0x1b294f297b1ed534 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.612697:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a91252f2/0x1b294f297b1ed534 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.612707:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a91252f2/0x1b294f297b1ed534 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.612715:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813286.612716:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813286.614913:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788813286.614926:0:15045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a91252f2/0x1b294f297b1ed534 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788813286.615531:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813286.615539:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000766918a3/0x1b294f297b1ed53b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.615553:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1788813286.615558:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.615564:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000766918a3/0x1b294f297b1ed53b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.615694:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000766918a3/0x1b294f297b1ed53b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.615705:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000766918a3/0x1b294f297b1ed53b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.615808:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000766918a3/0x1b294f297b1ed53b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.616478:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813286.616487:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000766918a3/0x1b294f297b1ed53b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.616497:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef01516000 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813286.616501:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000766918a3/0x1b294f297b1ed53b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.616511:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000766918a3/0x1b294f297b1ed53b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.616529:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000766918a3/0x1b294f297b1ed53b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.616540:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813286.616542:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813286.616545:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813286.621683:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788813286.621697:0:15045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000766918a3/0x1b294f297b1ed53b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788813286.622831:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813286.622841:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f721b50b/0x1b294f297b1ed542 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.622857:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1788813286.622862:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.622869:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f721b50b/0x1b294f297b1ed542 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.622885:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f721b50b/0x1b294f297b1ed542 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.622909:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f721b50b/0x1b294f297b1ed542 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.622917:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f721b50b/0x1b294f297b1ed542 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.622936:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813286.623132:0:16048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813286.623140:0:16048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f721b50b/0x1b294f297b1ed542 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.623150:0:16048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef01516c00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:1.0:1788813286.623154:0:16048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f721b50b/0x1b294f297b1ed542 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.623164:0:16048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f721b50b/0x1b294f297b1ed542 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.623187:0:16048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f721b50b/0x1b294f297b1ed542 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.623194:0:16048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f721b50b/0x1b294f297b1ed542 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.623215:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813286.623217:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813286.623219:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813286.624009:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813286.624259:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813286.624804:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813286.624814:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed549 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.624829:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=447s v=(0 0) 00010000:00010000:2.0:1788813286.624834:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.624840:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed549 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.624855:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed549 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.624865:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed549 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.624873:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed549 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.624901:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813286.625220:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813286.625226:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed549 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.625234:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164ec00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813286.625238:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed549 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.625247:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed549 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.625261:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed549 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.625268:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed549 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.625283:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813286.625285:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813286.625287:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813286.625959:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813286.625967:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d83b5e0a/0x1b294f297b1ed550 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.625979:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=447s v=(0 0) 00010000:00010000:2.0:1788813286.625983:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.625988:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d83b5e0a/0x1b294f297b1ed550 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.625998:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d83b5e0a/0x1b294f297b1ed550 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.626007:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d83b5e0a/0x1b294f297b1ed550 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.626014:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d83b5e0a/0x1b294f297b1ed550 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.626029:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788813286.626455:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813286.626461:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003daef944/0x1b294f297b1ed557 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.626757:0:16048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813286.626765:0:16048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d83b5e0a/0x1b294f297b1ed550 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.626798:0:16048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e400 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813286.626801:0:16048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d83b5e0a/0x1b294f297b1ed550 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.626811:0:16048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d83b5e0a/0x1b294f297b1ed550 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.626841:0:16048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d83b5e0a/0x1b294f297b1ed550 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.626849:0:16048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d83b5e0a/0x1b294f297b1ed550 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.626863:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813286.626865:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813286.626866:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813286.627114:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=447s v=(0 0) 00010000:00010000:2.0:1788813286.627127:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.627132:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003daef944/0x1b294f297b1ed557 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.627143:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003daef944/0x1b294f297b1ed557 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.627152:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003daef944/0x1b294f297b1ed557 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.627159:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003daef944/0x1b294f297b1ed557 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.627182:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788813286.627670:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813286.627676:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007f7e866/0x1b294f297b1ed55e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.627684:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=447s v=(0 0) 00010000:00010000:2.0:1788813286.627688:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.627692:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007f7e866/0x1b294f297b1ed55e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.627701:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007f7e866/0x1b294f297b1ed55e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.627901:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007f7e866/0x1b294f297b1ed55e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.627915:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007f7e866/0x1b294f297b1ed55e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.627932:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788813286.628343:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813286.628348:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000642057ec/0x1b294f297b1ed565 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.628357:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=447s v=(0 0) 00010000:00010000:2.0:1788813286.628360:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.628364:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000642057ec/0x1b294f297b1ed565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.628374:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000642057ec/0x1b294f297b1ed565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.628381:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000642057ec/0x1b294f297b1ed565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.628388:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000642057ec/0x1b294f297b1ed565 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.628405:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788813286.628803:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788813286.628813:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003daef944/0x1b294f297b1ed557 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.628822:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e800 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813286.628828:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003daef944/0x1b294f297b1ed557 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.628837:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003daef944/0x1b294f297b1ed557 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.628854:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003daef944/0x1b294f297b1ed557 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.628861:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003daef944/0x1b294f297b1ed557 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.628892:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788813286.628896:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007f7e866/0x1b294f297b1ed55e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.628902:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164fa00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813286.628905:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007f7e866/0x1b294f297b1ed55e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.628911:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007f7e866/0x1b294f297b1ed55e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.628924:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007f7e866/0x1b294f297b1ed55e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.628932:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007f7e866/0x1b294f297b1ed55e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.628945:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813286.628949:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000642057ec/0x1b294f297b1ed565 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.628955:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164ea00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813286.628958:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000642057ec/0x1b294f297b1ed565 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.628977:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000642057ec/0x1b294f297b1ed565 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.628989:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000642057ec/0x1b294f297b1ed565 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.628997:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000642057ec/0x1b294f297b1ed565 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.629011:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813286.629013:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813286.629015:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813286.629030:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813286.629037:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d450084d/0x1b294f297b1ed56c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.629051:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=447s v=(0 0) 00010000:00010000:2.0:1788813286.629054:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.629058:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d450084d/0x1b294f297b1ed56c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.629068:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d450084d/0x1b294f297b1ed56c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.629075:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d450084d/0x1b294f297b1ed56c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.629082:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d450084d/0x1b294f297b1ed56c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.629166:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813286.629358:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813286.629363:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d450084d/0x1b294f297b1ed56c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.629371:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f400 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813286.629375:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d450084d/0x1b294f297b1ed56c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.629382:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d450084d/0x1b294f297b1ed56c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.629392:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d450084d/0x1b294f297b1ed56c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.629411:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d450084d/0x1b294f297b1ed56c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.629425:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813286.629427:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813286.629430:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813286.629628:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813286.629634:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085e87aaa/0x1b294f297b1ed573 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.629643:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=447s v=(0 0) 00010000:00010000:2.0:1788813286.629646:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.629650:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085e87aaa/0x1b294f297b1ed573 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.629659:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085e87aaa/0x1b294f297b1ed573 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.629688:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085e87aaa/0x1b294f297b1ed573 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.629695:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085e87aaa/0x1b294f297b1ed573 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.630012:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788813286.630449:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813286.630455:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f51d276/0x1b294f297b1ed57a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.630465:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=447s v=(0 0) 00010000:00010000:2.0:1788813286.630561:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.630567:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f51d276/0x1b294f297b1ed57a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.630577:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f51d276/0x1b294f297b1ed57a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.630585:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f51d276/0x1b294f297b1ed57a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.630592:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f51d276/0x1b294f297b1ed57a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.631155:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788813286.631164:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085e87aaa/0x1b294f297b1ed573 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.631174:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f600 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813286.631180:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085e87aaa/0x1b294f297b1ed573 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.631184:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813286.631194:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085e87aaa/0x1b294f297b1ed573 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.631212:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085e87aaa/0x1b294f297b1ed573 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.631220:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085e87aaa/0x1b294f297b1ed573 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.631240:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813286.631243:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f51d276/0x1b294f297b1ed57a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.631258:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164fc00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813286.631262:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f51d276/0x1b294f297b1ed57a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.631269:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f51d276/0x1b294f297b1ed57a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.631281:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f51d276/0x1b294f297b1ed57a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.631288:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f51d276/0x1b294f297b1ed57a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.631303:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813286.631305:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813286.631308:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788813286.631693:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813286.631700:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014de447b/0x1b294f297b1ed581 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.631936:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=447s v=(0 0) 00010000:00010000:2.0:1788813286.631940:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.631946:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014de447b/0x1b294f297b1ed581 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.631957:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014de447b/0x1b294f297b1ed581 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.631966:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014de447b/0x1b294f297b1ed581 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.631973:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014de447b/0x1b294f297b1ed581 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.631990:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788813286.632548:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813286.632554:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003284be70/0x1b294f297b1ed588 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.632563:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=447s v=(0 0) 00010000:00010000:2.0:1788813286.632572:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813286.632576:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003284be70/0x1b294f297b1ed588 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.632586:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003284be70/0x1b294f297b1ed588 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.632595:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003284be70/0x1b294f297b1ed588 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.632602:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003284be70/0x1b294f297b1ed588 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813286.632610:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1788813286.633047:0:15045:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1788813286.633320:0:15045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14384:x1875706322713856:12345-0@lo:5:osp-pre-1-0.0 Request processed in 64449us (64864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813286.633330:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788813286.633378:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14384:1875706322713856:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788813286.633392:0:14384:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1788813286.633435:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36163480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14384:1875706322713984:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788813286.633807:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813286.633850:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ee066bb240 going to sleep for 11 seconds 00000100:00100000:2.0:1788813286.633869:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322713984 00000100:00100000:2.0:1788813286.633876:0:15043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322713984 00000100:00100000:2.0:1788813286.633914:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788813286.633922:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36160a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14384:x1875706322713984:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788813286.633967:0:15043:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1788813286.634305:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788813286.634314:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014de447b/0x1b294f297b1ed581 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.634324:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f200 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813286.634329:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014de447b/0x1b294f297b1ed581 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.634350:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014de447b/0x1b294f297b1ed581 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.634368:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014de447b/0x1b294f297b1ed581 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813286.634375:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014de447b/0x1b294f297b1ed581 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.635610:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813286.635619:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003284be70/0x1b294f297b1ed588 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.635632:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164ee00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813286.635635:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003284be70/0x1b294f297b1ed588 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.635646:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003284be70/0x1b294f297b1ed588 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813286.635934:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813286.636861:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003284be70/0x1b294f297b1ed588 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.636875:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003284be70/0x1b294f297b1ed588 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813286.636897:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813286.636899:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813286.636901:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813286.639300:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813286.639303:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813286.639307:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813286.666226:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36160a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14384:x1875706322713984:12345-0@lo:5:osp-pre-1-0.0 Request processed in 32297us (32750us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788813286.666241:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788813286.666320:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36163480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14384:1875706322713984:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788813286.666337:0:14384:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1788813287.197570:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788813288.099475:0:16119:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788813288.226211:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813289.117178:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36160700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322714112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813289.117248:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813289.117617:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322714112 00000100:00100000:2.0:1788813289.117625:0:15046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322714112 00000100:00100000:2.0:1788813289.117697:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788813289.117708:0:15046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322714112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813289.117755:0:15046:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788813289.117818:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813289.117841:0:15046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322714112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813289.117848:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788813289.117937:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36160700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322714112:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788813289.250490:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813290.274133:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813290.446114:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813290.446316:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308042368 00000100:00100000:0.0:1788813290.446327:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308042368 00000100:00100000:0.0:1788813290.446377:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:0.0:1788813290.446385:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36962050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2362:x1875706308042368:12345-192.168.203.13@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788813290.446411:0:14353:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from cd9f5279-f53e-4261-be49-522548830288@192.168.203.13@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:0.0:1788813290.446439:0:14353:0:(genops.c:1384:class_connect()) connect: client cd9f5279-f53e-4261-be49-522548830288, cookie 0x1b294f297b1ed58f 00000100:00080000:0.0:1788813290.446559:0:14353:0:(import.c:65:import_set_state_nolock()) ffff93ef21255000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788813290.446626:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36962050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd9f5279-f53e-4261-be49-522548830288+5:2362:x1875706308042368:12345-192.168.203.13@tcp:250:mount.lustre.0 Request processed in 241us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813290.446633:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:1.0:1788813290.459600:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813290.459704:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308042496 00000100:00100000:3.0:1788813290.459720:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308042496 00000100:00100000:3.0:1788813290.459842:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:3.0:1788813290.459857:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36963850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+5:13739:x1875706308042496:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788813290.459880:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813290.459904:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ed596 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2e12 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813290.459943:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ed596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2e12 expref: 6 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813290.459977:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef4214ce00/0x1b294f297b1ed596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2e12 expref: 6 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813290.459989:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef4214ce00, rc 0) 00000100:00100000:3.0:1788813290.460087:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36963850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+6:13739:x1875706308042496:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 228us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813290.460095:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:3.0:1788813290.464196:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813290.464464:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308042624 00000100:00100000:1.0:1788813290.464478:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308042624 00000100:00100000:1.0:1788813290.464551:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:1.0:1788813290.464563:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36961050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd9f5279-f53e-4261-be49-522548830288+6:13739:x1875706308042624:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788813290.465019:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36961050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd9f5279-f53e-4261-be49-522548830288+6:13739:x1875706308042624:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 457us (836us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788813290.465029:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:1.0:1788813290.469860:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813290.469962:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308042752 00000100:00100000:0.0:1788813290.469975:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308042752 00000100:00100000:0.0:1788813290.470051:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:0.0:1788813290.470062:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36960c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd9f5279-f53e-4261-be49-522548830288+6:13739:x1875706308042752:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788813290.470094:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813290.470119:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef190cec00/0x1b294f297b1ed59d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2e19 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813290.470157:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef190cec00/0x1b294f297b1ed59d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2e19 expref: 7 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813290.470171:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef190cec00/0x1b294f297b1ed59d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2e19 expref: 7 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813290.470183:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cec00, rc 0) 00000100:00100000:0.0:1788813290.470258:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36960c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd9f5279-f53e-4261-be49-522548830288+7:13739:x1875706308042752:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 198us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813290.470266:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:2.0:1788813290.473287:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813290.475532:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308042880 00000100:00100000:3.0:1788813290.475548:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308042880 00000100:00100000:3.0:1788813290.475705:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:3.0:1788813290.475717:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36961450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+7:13739:x1875706308042880:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788813290.476521:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36961450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+8:13739:x1875706308042880:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 802us (3240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813290.476531:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:3.0:1788813290.485568:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813290.486442:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308043008 00000100:00100000:1.0:1788813290.486457:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308043008 00000100:00100000:1.0:1788813290.486533:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:1.0:1788813290.486541:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36962450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd9f5279-f53e-4261-be49-522548830288+8:13739:x1875706308043008:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788813290.487245:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36962450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd9f5279-f53e-4261-be49-522548830288+8:13739:x1875706308043008:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 700us (1690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813290.487255:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:0.0:1788813290.492976:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813290.493166:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308043136 00000100:00100000:3.0:1788813290.493180:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308043136 00000100:00100000:3.0:1788813290.493249:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:3.0:1788813290.493262:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36961c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+8:13758:x1875706308043136:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788813290.493928:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36961c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+8:13758:x1875706308043136:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 664us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813290.493940:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:2.0:1788813290.509035:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813290.509144:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308043264 00000100:00100000:0.0:1788813290.509156:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308043264 00000100:00100000:1.0:1788813290.509350:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:1.0:1788813290.509374:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36963c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd9f5279-f53e-4261-be49-522548830288+8:13758:x1875706308043264:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788813290.510047:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36963c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd9f5279-f53e-4261-be49-522548830288+8:13758:x1875706308043264:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 679us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813290.510058:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:0.0:1788813290.521245:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813290.528880:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308043392 00000100:00100000:3.0:1788813290.528900:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308043392 00000100:00100000:0.0:1788813290.529838:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:0.0:1788813290.529852:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36962c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+8:13739:x1875706308043392:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788813290.529873:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813290.529894:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef190cf800/0x1b294f297b1ed5a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2e43 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813290.529941:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef190cf800/0x1b294f297b1ed5a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2e43 expref: 9 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813290.529952:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef190cf800/0x1b294f297b1ed5a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2e43 expref: 9 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813290.529963:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cf800, rc 0) 00000100:00100000:0.0:1788813290.532778:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36962c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+9:13739:x1875706308043392:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 188us (8806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813290.532817:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:0.0:1788813290.534742:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813290.534881:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308043520 00000100:00100000:1.0:1788813290.534894:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308043520 00000100:00100000:1.0:1788813290.534965:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:1.0:1788813290.534977:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36963450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd9f5279-f53e-4261-be49-522548830288+9:13739:x1875706308043520:12345-192.168.203.13@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788813290.535011:0:14354:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788813290.535055:0:14354:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788813290.535060:0:14354:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788813290.535065:0:14354:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788813290.535067:0:14354:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788813290.538191:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36963450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd9f5279-f53e-4261-be49-522548830288+9:13739:x1875706308043520:12345-192.168.203.13@tcp:256:mount.lustre.0 Request processed in 3200us (3446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813290.538208:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:3.0:1788813290.542368:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813290.542651:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308043648 00000100:00100000:0.0:1788813290.542665:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308043648 00000100:00100000:0.0:1788813290.542727:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:0.0:1788813290.542740:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+9:13739:x1875706308043648:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788813290.542761:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813290.542808:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef190ce600/0x1b294f297b1ed5ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2e4a expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813290.542846:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef190ce600/0x1b294f297b1ed5ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2e4a expref: 10 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813290.542860:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef190ce600/0x1b294f297b1ed5ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2e4a expref: 10 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813290.542871:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190ce600, rc 0) 00000100:00100000:0.0:1788813290.542939:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+10:13739:x1875706308043648:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 201us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813290.542965:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:2.0:1788813290.547702:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813290.547854:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308043776 00000100:00100000:3.0:1788813290.547868:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308043776 00000100:00100000:3.0:1788813290.547944:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:3.0:1788813290.547956:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd9f5279-f53e-4261-be49-522548830288+10:13739:x1875706308043776:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788813290.548349:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd9f5279-f53e-4261-be49-522548830288+10:13739:x1875706308043776:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 394us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813290.548358:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:3.0:1788813290.550866:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813290.551430:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308043904 00000100:00100000:2.0:1788813290.551444:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308043904 00000100:00100000:2.0:1788813290.551514:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:2.0:1788813290.551527:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd9f5279-f53e-4261-be49-522548830288+10:13739:x1875706308043904:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788813290.551964:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd9f5279-f53e-4261-be49-522548830288+10:13739:x1875706308043904:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 436us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813290.551974:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:3.0:1788813290.556565:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813290.557192:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308044032 00000100:00100000:2.0:1788813290.557206:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308044032 00000100:00100000:2.0:1788813290.557286:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00100000:2.0:1788813290.557299:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+10:13762:x1875706308044032:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788813290.558057:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+10:13762:x1875706308044032:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 748us (1492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813290.558069:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00100000:0.0:1788813290.568973:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813290.569113:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308044160 00000100:00100000:1.0:1788813290.569126:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308044160 00000100:00100000:1.0:1788813290.569202:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:1.0:1788813290.569214:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd9f5279-f53e-4261-be49-522548830288+10:13762:x1875706308044160:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788813290.569560:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd9f5279-f53e-4261-be49-522548830288+10:13762:x1875706308044160:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 347us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813290.569577:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:3.0:1788813290.594883:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813290.595136:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308044288 00000100:00100000:2.0:1788813290.595150:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308044288 00000100:00100000:2.0:1788813290.595202:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:2.0:1788813290.595212:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2362:x1875706308044288:12345-192.168.203.13@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788813290.595248:0:14361:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 6a4682b5-f19d-455b-8e64-4014cc43b65c@192.168.203.13@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:2.0:1788813290.595312:0:14361:0:(genops.c:1384:class_connect()) connect: client 6a4682b5-f19d-455b-8e64-4014cc43b65c, cookie 0x1b294f297b1ed5b2 00000004:00100000:2.0:1788813290.595349:0:14361:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788813290.595356:0:14361:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1788813290.644189:0:14361:0:(import.c:65:import_set_state_nolock()) ffff93ee049f1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788813290.644351:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+6:2362:x1875706308044288:12345-192.168.203.13@tcp:38:mount.lustre.0 Request processed in 49137us (49483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813290.644364:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:0.0:1788813290.646957:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813290.647001:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813290.647119:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308044416 00000100:00100000:1.0:1788813290.647132:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308044416 00000100:00100000:1.0:1788813290.647216:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308044544 00000100:00100000:1.0:1788813290.647220:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308044544 00000100:00100000:1.0:1788813290.647246:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:1.0:1788813290.647257:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+7:0:x1875706308044416:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788813290.647315:0:14360:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788813290.647434:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+7:0:x1875706308044416:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 177us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813290.647441:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:1.0:1788813290.647461:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:1.0:1788813290.647468:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+6:13739:x1875706308044544:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788813290.647480:0:14360:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788813290.647503:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+6:13739:x1875706308044544:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 36us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813290.647509:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00080000:0.0:1788813290.647983:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813290.650291:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813290.650514:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308044672 00000100:00100000:1.0:1788813290.650527:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308044672 00000100:00100000:1.0:1788813290.650730:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1788813290.650744:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+6:13739:x1875706308044672:12345-192.168.203.13@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788813290.650904:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+6:13739:x1875706308044672:12345-192.168.203.13@tcp:40:mount.lustre.0 Request processed in 163us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813290.653916:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813290.653970:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813290.654001:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813290.654033:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308044800 00000100:00100000:3.0:1788813290.654056:0:15045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308044800 00000100:00100000:3.0:1788813290.654108:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308044928 00000100:00100000:3.0:1788813290.654112:0:15045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308044928 00000100:00100000:3.0:1788813290.654127:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:3.0:1788813290.654137:0:15045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1875706308044800:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788813290.654175:0:15045:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 6a4682b5-f19d-455b-8e64-4014cc43b65c@192.168.203.13@tcp t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:3.0:1788813290.654216:0:15045:0:(genops.c:1384:class_connect()) connect: client 6a4682b5-f19d-455b-8e64-4014cc43b65c, cookie 0x1b294f297b1ed5b9 00002000:00100000:3.0:1788813290.654231:0:15045:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6a4682b5-f19d-455b-8e64-4014cc43b65c/ffff93ef20d9d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788813290.654262:0:15045:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788813290.654529:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308045056 00000100:00100000:2.0:1788813290.654536:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308045056 00000100:00100000:2.0:1788813290.654578:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:2.0:1788813290.654586:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+7:13739:x1875706308045056:12345-192.168.203.13@tcp:33:mount.lustre.0 00000004:00080000:2.0:1788813290.655287:0:14362:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 616us 00002000:00080000:3.0:1788813290.656913:0:15045:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788813290.656974:0:15045:0:(import.c:65:import_set_state_nolock()) ffff93ef20d98800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813290.659534:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:3.0:1788813290.659563:0:15045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+6:2362:x1875706308044800:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 5422us (5588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813290.659577:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:3.0:1788813290.659606:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:3.0:1788813290.659614:0:15045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1875706308044928:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788813290.659663:0:15045:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 6a4682b5-f19d-455b-8e64-4014cc43b65c@192.168.203.13@tcp t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:3.0:1788813290.659698:0:15045:0:(genops.c:1384:class_connect()) connect: client 6a4682b5-f19d-455b-8e64-4014cc43b65c, cookie 0x1b294f297b1ed5c0 00002000:00100000:3.0:1788813290.659712:0:15045:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6a4682b5-f19d-455b-8e64-4014cc43b65c/ffff93ef20d9b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788813290.659741:0:15045:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788813290.659982:0:15045:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788813290.660024:0:15045:0:(import.c:65:import_set_state_nolock()) ffff93ef20d98000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788813290.660074:0:15045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+6:2362:x1875706308044928:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 459us (6072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813290.660081:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000004:00200000:2.0:1788813290.677208:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788813290.677467:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+6:13739:x1875706308045056:12345-192.168.203.13@tcp:33:mount.lustre.0 Request processed in 22872us (23557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813290.677481:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:3.0:1788813290.870215:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813290.871343:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308045184 00000100:00100000:1.0:1788813290.871361:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308045184 00000100:00100000:1.0:1788813290.871527:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:1.0:1788813290.871541:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+6:13783:x1875706308045184:12345-192.168.203.13@tcp:101:mkdir.0 00010000:00010000:1.0:1788813290.871567:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813290.875116:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ed5c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2e74 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813290.875218:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc600/0x1b294f297b1ed5ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813290.875232:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc600/0x1b294f297b1ed5ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813290.875247:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc600/0x1b294f297b1ed5ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813290.875286:0:14361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788813290.875290:0:14361:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813290.875324:0:14361:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc600/0x1b294f297b1ed5ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813290.875356:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fca00/0x1b294f297b1ed5c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2e74 expref: 8 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813290.875378:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc600/0x1b294f297b1ed5ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2e74 expref: 7 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813290.875387:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef19f1fd00) 00010000:00010000:1.0:1788813290.875390:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813290.875406:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fc600, rc 0) 00000100:00100000:1.0:1788813290.875481:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+7:13783:x1875706308045184:12345-192.168.203.13@tcp:101:mkdir.0 Request processed in 3943us (5279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813290.875490:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00010000:00010000:0.0:1788813291.296383:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813291.677102:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322714240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813291.677185:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813291.677276:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813291.677288:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3301:1875706322714368:0@lo:400:kworker.0 00000100:00100000:3.0:1788813291.677329:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813291.677420:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322714368 00000100:00100000:0.0:1788813291.677446:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322714368 00000100:00100000:0.0:1788813291.677509:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788813291.677521:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:3301:x1875706322714368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813291.677610:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:3301:x1875706322714368:12345-0@lo:400:kworker.0 Request processed in 91us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813291.677617:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788813291.677704:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322714496:0@lo:400:kworker.0 00000100:00100000:0.0:1788813291.677739:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813291.679476:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875706322714624:0@lo:400:kworker.0 00000100:00100000:3.0:1788813291.679564:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813291.680233:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3301:1875706322714368:0@lo:400:kworker.0 00000100:00100000:3.0:1788813291.680265:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322714240 00000100:00100000:3.0:1788813291.680286:0:15047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322714240 00000100:00100000:3.0:1788813291.680345:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788813291.680353:0:15047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1875706322714240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813291.680381:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813291.680518:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322714496 00000100:00100000:0.0:1788813291.680529:0:15043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322714496 00000100:00100000:0.0:1788813291.680584:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788813291.680595:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36eca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322714496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813291.680696:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36eca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322714496:12345-0@lo:400:kworker.0 Request processed in 103us (2956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813291.680704:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788813291.680746:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322714624 00000100:00100000:0.0:1788813291.680751:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322714624 00000100:00100000:0.0:1788813291.680884:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788813291.680892:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875706322714624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813291.680942:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875706322714624:12345-0@lo:400:kworker.0 Request processed in 51us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813291.680948:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788813291.681064:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788813291.681070:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788813291.681107:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875706322714624:0@lo:400:kworker.0 00000100:00100000:0.0:1788813291.681149:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322714496:0@lo:400:kworker.0 00000100:00100000:3.0:1788813291.683258:0:15047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1875706322714240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2898us (6064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813291.683273:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788813291.683372:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322714240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813291.687892:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813291.687923:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1875706322714752:0@lo:400:kworker.0 00000100:00100000:1.0:1788813291.688051:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813291.688537:0:16041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322714752 00000100:00100000:1.0:1788813291.688548:0:16041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322714752 00000100:00100000:1.0:1788813291.688621:0:16041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788813291.688642:0:16041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875706322714752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813291.688712:0:16041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875706322714752:12345-0@lo:400:kworker.0 Request processed in 72us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813291.688742:0:16041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788813291.688767:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813291.688832:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1875706322714752:0@lo:400:kworker.0 00000100:00100000:1.0:1788813291.688970:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1875706322714880:0@lo:400:kworker.0 00000100:00100000:1.0:1788813291.688998:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813291.689031:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322714880 00000100:00100000:1.0:1788813291.689034:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322714880 00000100:00100000:1.0:1788813291.689063:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788813291.689069:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875706322714880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813291.689102:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875706322714880:12345-0@lo:400:kworker.0 Request processed in 34us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813291.689108:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788813291.689120:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813291.689154:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1875706322714880:0@lo:400:kworker.0 00000001:00080000:3.0:1788813291.760408:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1788813291.760549:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788813291.760694:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6a4682b5-f19d-455b-8e64-4014cc43b65c 00010000:00010000:0.0:1788813292.317805:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813292.778305:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813292.778500:0:16041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308045312 00000100:00100000:1.0:1788813292.778514:0:16041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308045312 00000100:00100000:1.0:1788813292.778617:0:16041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:1.0:1788813292.778640:0:16041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a4682b5-f19d-455b-8e64-4014cc43b65c+7:13835:x1875706308045312:12345-192.168.203.13@tcp:41:lfs.0 00000004:00000024:1.0:1788813292.778703:0:16041:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788813292.778866:0:16041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a4682b5-f19d-455b-8e64-4014cc43b65c+7:13835:x1875706308045312:12345-192.168.203.13@tcp:41:lfs.0 Request processed in 228us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813292.778874:0:16041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00080000:2.0:1788813292.779369:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813292.782936:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813292.785033:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308045440 00000100:00100000:2.0:1788813292.785055:0:15046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308045440 00000100:00100000:2.0:1788813292.785191:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:2.0:1788813292.785205:0:15046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6a4682b5-f19d-455b-8e64-4014cc43b65c+6:13835:x1875706308045440:12345-192.168.203.13@tcp:13:lfs.0 00002000:00000024:2.0:1788813292.785260:0:15046:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813292.785846:0:15046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6a4682b5-f19d-455b-8e64-4014cc43b65c+6:13835:x1875706308045440:12345-192.168.203.13@tcp:13:lfs.0 Request processed in 637us (2917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813292.785858:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00080000:1.0:1788813292.785967:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813292.794829:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813292.797227:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308045568 00000100:00100000:3.0:1788813292.797249:0:15047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308045568 00000100:00100000:3.0:1788813292.797463:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:3.0:1788813292.797478:0:15047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6a4682b5-f19d-455b-8e64-4014cc43b65c+5:13835:x1875706308045568:12345-192.168.203.13@tcp:13:lfs.0 00002000:00000024:3.0:1788813292.797532:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813292.797673:0:15047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6a4682b5-f19d-455b-8e64-4014cc43b65c+5:13835:x1875706308045568:12345-192.168.203.13@tcp:13:lfs.0 Request processed in 197us (2889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813292.797681:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00080000:1.0:1788813292.800227:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788813292.976982:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813292.977259:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308045696 00000100:00100000:2.0:1788813292.977272:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308045696 00000100:00100000:2.0:1788813292.977349:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:2.0:1788813292.977361:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+10:13866:x1875706308045696:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788813292.977382:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813292.977406:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef1164ea00/0x1b294f297b1ed5d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2e7b expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813292.977447:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef1164ea00/0x1b294f297b1ed5d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2e7b expref: 11 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813292.977461:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef1164ea00/0x1b294f297b1ed5d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2e7b expref: 11 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813292.977471:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164ea00, rc 0) 00000100:00100000:2.0:1788813292.977556:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+11:13866:x1875706308045696:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 197us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813292.977563:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:0.0:1788813292.984526:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813292.987415:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308045824 00000100:00100000:1.0:1788813292.987437:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308045824 00000100:00100000:1.0:1788813292.987540:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:1.0:1788813292.987554:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd9f5279-f53e-4261-be49-522548830288+11:13866:x1875706308045824:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788813292.989596:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd9f5279-f53e-4261-be49-522548830288+11:13866:x1875706308045824:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 2030us (5072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813292.989630:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:3.0:1788813292.998707:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813292.998849:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308045952 00000100:00100000:0.0:1788813292.998863:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308045952 00000100:00100000:0.0:1788813292.998935:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 92 00000100:00100000:0.0:1788813292.998947:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd9f5279-f53e-4261-be49-522548830288+11:13866:x1875706308045952:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788813292.999513:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd9f5279-f53e-4261-be49-522548830288+11:13866:x1875706308045952:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 566us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813292.999524:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 92 00000100:00100000:0.0:1788813293.006981:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813293.007219:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308046080 00000100:00100000:1.0:1788813293.007231:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308046080 00000100:00100000:1.0:1788813293.007305:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:1.0:1788813293.007316:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd9f5279-f53e-4261-be49-522548830288+11:13874:x1875706308046080:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788813293.007746:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd9f5279-f53e-4261-be49-522548830288+11:13874:x1875706308046080:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 430us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813293.007756:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:3.0:1788813293.024697:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813293.024878:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308046208 00000100:00100000:0.0:1788813293.024892:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308046208 00000100:00100000:0.0:1788813293.024964:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00100000:0.0:1788813293.024976:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd9f5279-f53e-4261-be49-522548830288+11:13874:x1875706308046208:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788813293.026810:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd9f5279-f53e-4261-be49-522548830288+11:13874:x1875706308046208:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 1804us (2094us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813293.026844:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00100000:3.0:1788813293.036391:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813293.039317:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308046336 00000100:00100000:2.0:1788813293.039359:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308046336 00000100:00100000:2.0:1788813293.039453:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 95 00000100:00100000:2.0:1788813293.039466:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+11:13866:x1875706308046336:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788813293.039489:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813293.039514:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef1164fa00/0x1b294f297b1ed5dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2ea5 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813293.039552:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef1164fa00/0x1b294f297b1ed5dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ea5 expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813293.039567:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef1164fa00/0x1b294f297b1ed5dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ea5 expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813293.039578:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164fa00, rc 0) 00000100:00100000:2.0:1788813293.039764:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+12:13866:x1875706308046336:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 300us (3387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813293.039772:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 95 00000100:00100000:3.0:1788813293.047872:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813293.048582:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308046464 00000100:00100000:1.0:1788813293.049588:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308046464 00000100:00100000:1.0:1788813293.049873:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 96 00000100:00100000:1.0:1788813293.049885:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd9f5279-f53e-4261-be49-522548830288+12:13866:x1875706308046464:12345-192.168.203.13@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788813293.049917:0:14354:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788813293.049961:0:14354:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788813293.049966:0:14354:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788813293.049970:0:14354:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788813293.049973:0:14354:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788813293.054521:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd9f5279-f53e-4261-be49-522548830288+12:13866:x1875706308046464:12345-192.168.203.13@tcp:256:mount.lustre.0 Request processed in 4620us (6647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813293.054538:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 96 00000100:00100000:3.0:1788813293.062277:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813293.062590:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308046592 00000100:00100000:2.0:1788813293.062654:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308046592 00000100:00100000:2.0:1788813293.062856:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:2.0:1788813293.062869:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+12:13866:x1875706308046592:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788813293.062891:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813293.062912:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef1164e800/0x1b294f297b1ed5e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2eac expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813293.062949:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef1164e800/0x1b294f297b1ed5e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2eac expref: 13 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813293.062963:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef1164e800/0x1b294f297b1ed5e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2eac expref: 13 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813293.062990:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164e800, rc 0) 00000100:00100000:2.0:1788813293.063071:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+13:13866:x1875706308046592:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 204us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813293.063079:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:3.0:1788813293.064591:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813293.064887:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308046720 00000100:00100000:1.0:1788813293.064898:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308046720 00000100:00100000:1.0:1788813293.064951:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:1.0:1788813293.064962:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee06feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd9f5279-f53e-4261-be49-522548830288+13:13866:x1875706308046720:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788813293.065596:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee06feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd9f5279-f53e-4261-be49-522548830288+13:13866:x1875706308046720:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 633us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813293.065613:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:3.0:1788813293.067855:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813293.067934:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308046848 00000100:00100000:1.0:1788813293.067945:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308046848 00000100:00100000:1.0:1788813293.068009:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:1.0:1788813293.068019:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2101b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd9f5279-f53e-4261-be49-522548830288+13:13866:x1875706308046848:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788813293.068400:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2101b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd9f5279-f53e-4261-be49-522548830288+13:13866:x1875706308046848:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 381us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813293.068409:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:0.0:1788813293.072678:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813293.073092:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308046976 00000100:00100000:2.0:1788813293.073106:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308046976 00000100:00100000:2.0:1788813293.073186:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:2.0:1788813293.073198:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+13:13880:x1875706308046976:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788813293.073540:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+13:13880:x1875706308046976:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 344us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813293.073549:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:0.0:1788813293.078460:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813293.078570:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308047104 00000100:00100000:2.0:1788813293.078584:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308047104 00000100:00100000:2.0:1788813293.078666:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00100000:2.0:1788813293.078678:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd9f5279-f53e-4261-be49-522548830288+13:13880:x1875706308047104:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788813293.079417:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd9f5279-f53e-4261-be49-522548830288+13:13880:x1875706308047104:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 737us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813293.079429:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00100000:3.0:1788813293.091504:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813293.091561:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813293.091693:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813293.091939:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308047872 00000100:00100000:2.0:1788813293.091953:0:15043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308047872 00000100:00100000:2.0:1788813293.092026:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308047744 00000100:00100000:2.0:1788813293.092038:0:15043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308047744 00000100:00100000:2.0:1788813293.092064:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:2.0:1788813293.092076:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+5:2366:x1875706308047872:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813293.092187:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+5:2366:x1875706308047872:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 114us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813293.092195:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:2.0:1788813293.092214:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:2.0:1788813293.092219:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+6:2366:x1875706308047744:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813293.092242:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+6:2366:x1875706308047744:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 23us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813293.092247:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:1.0:1788813293.092565:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308047616 00000100:00100000:1.0:1788813293.092577:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308047616 00000100:00100000:1.0:1788813293.092633:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:1.0:1788813293.092640:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+7:2366:x1875706308047616:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813293.092681:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+7:2366:x1875706308047616:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 42us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813293.092689:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:2.0:1788813293.103935:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813293.104333:0:16041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308047232 00000100:00100000:1.0:1788813293.104346:0:16041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308047232 00000100:00100000:1.0:1788813293.104407:0:16041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:1.0:1788813293.104419:0:16041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2362:x1875706308047232:12345-192.168.203.13@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788813293.104457:0:16041:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from eedc6376-ef6e-4238-8e03-0517eb7ab48c@192.168.203.13@tcp t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:1.0:1788813293.104511:0:16041:0:(genops.c:1384:class_connect()) connect: client eedc6376-ef6e-4238-8e03-0517eb7ab48c, cookie 0x1b294f297b1ed5ea 00000004:00100000:1.0:1788813293.104551:0:16041:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788813293.104778:0:16041:0:(import.c:65:import_set_state_nolock()) ffff93ef36ed8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813293.104923:0:16041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eedc6376-ef6e-4238-8e03-0517eb7ab48c+6:2362:x1875706308047232:12345-192.168.203.13@tcp:38:mount.lustre.0 Request processed in 506us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813293.104934:0:16041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:1.0:1788813293.107500:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813293.107881:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308047488 00000100:00100000:0.0:1788813293.107897:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308047488 00000100:00100000:0.0:1788813293.108008:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:0.0:1788813293.108021:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eedc6376-ef6e-4238-8e03-0517eb7ab48c+6:13866:x1875706308047488:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788813293.108285:0:14359:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788813293.108400:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eedc6376-ef6e-4238-8e03-0517eb7ab48c+6:13866:x1875706308047488:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 382us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813293.108409:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00080000:1.0:1788813293.109181:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813293.109991:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813293.110131:0:16041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308047360 00000100:00100000:1.0:1788813293.110142:0:16041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308047360 00000100:00100000:1.0:1788813293.110207:0:16041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:1.0:1788813293.110219:0:16041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eedc6376-ef6e-4238-8e03-0517eb7ab48c+6:0:x1875706308047360:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788813293.110254:0:16041:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788813293.110337:0:16041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eedc6376-ef6e-4238-8e03-0517eb7ab48c+6:0:x1875706308047360:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 121us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813293.110367:0:16041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:3.0:1788813293.111553:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813293.111701:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308048000 00000100:00100000:0.0:1788813293.111710:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308048000 00000100:00100000:0.0:1788813293.111775:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:0.0:1788813293.111809:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eedc6376-ef6e-4238-8e03-0517eb7ab48c+6:13866:x1875706308048000:12345-192.168.203.13@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788813293.111904:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eedc6376-ef6e-4238-8e03-0517eb7ab48c+6:13866:x1875706308048000:12345-192.168.203.13@tcp:40:mount.lustre.0 Request processed in 121us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813293.111910:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:0.0:1788813293.115196:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813293.115244:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813293.115286:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813293.115383:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308048128 00000100:00100000:3.0:1788813293.115397:0:15043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308048128 00000100:00100000:3.0:1788813293.115445:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308048256 00000100:00100000:3.0:1788813293.115448:0:15043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308048256 00000100:00100000:3.0:1788813293.115464:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:3.0:1788813293.115474:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2362:x1875706308048128:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788813293.115516:0:15043:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from eedc6376-ef6e-4238-8e03-0517eb7ab48c@192.168.203.13@tcp t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:3.0:1788813293.115559:0:15043:0:(genops.c:1384:class_connect()) connect: client eedc6376-ef6e-4238-8e03-0517eb7ab48c, cookie 0x1b294f297b1ed5f1 00002000:00100000:3.0:1788813293.115574:0:15043:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli eedc6376-ef6e-4238-8e03-0517eb7ab48c/ffff93ef20d9e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788813293.115588:0:15043:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788813293.115778:0:15043:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788813293.115858:0:15043:0:(import.c:65:import_set_state_nolock()) ffff93ef20d9f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788813293.115945:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eedc6376-ef6e-4238-8e03-0517eb7ab48c+6:2362:x1875706308048128:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 471us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813293.115954:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:3.0:1788813293.115974:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1788813293.115979:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2362:x1875706308048256:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788813293.115996:0:15043:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from eedc6376-ef6e-4238-8e03-0517eb7ab48c@192.168.203.13@tcp t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:3.0:1788813293.116019:0:15043:0:(genops.c:1384:class_connect()) connect: client eedc6376-ef6e-4238-8e03-0517eb7ab48c, cookie 0x1b294f297b1ed5f8 00002000:00100000:3.0:1788813293.116024:0:15043:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli eedc6376-ef6e-4238-8e03-0517eb7ab48c/ffff93ef20d99000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788813293.116051:0:15043:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788813293.116273:0:15043:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788813293.116290:0:15043:0:(import.c:65:import_set_state_nolock()) ffff93ef20d9a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788813293.116317:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eedc6376-ef6e-4238-8e03-0517eb7ab48c+6:2362:x1875706308048256:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 336us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813293.116324:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:2.0:1788813293.117762:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308048384 00000100:00100000:2.0:1788813293.117779:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308048384 00000100:00100000:2.0:1788813293.117879:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:2.0:1788813293.117891:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eedc6376-ef6e-4238-8e03-0517eb7ab48c+6:13866:x1875706308048384:12345-192.168.203.13@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788813293.117985:0:14363:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788813293.118086:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eedc6376-ef6e-4238-8e03-0517eb7ab48c+6:13866:x1875706308048384:12345-192.168.203.13@tcp:33:mount.lustre.0 Request processed in 196us (2903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813293.118093:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00000001:00100000:0.0:1788813293.277508:0:6700:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eedc6376-ef6e-4238-8e03-0517eb7ab48c 00000001:00100000:0.0:1788813293.277536:0:6700:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6a4682b5-f19d-455b-8e64-4014cc43b65c 00000100:00100000:0.0:1788813293.286014:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813293.286118:0:16041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308048512 00000100:00100000:1.0:1788813293.286132:0:16041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308048512 00000100:00100000:1.0:1788813293.286211:0:16041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:1.0:1788813293.286223:0:16041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eedc6376-ef6e-4238-8e03-0517eb7ab48c+6:13901:x1875706308048512:12345-192.168.203.13@tcp:101:mkdir.0 00010000:00010000:1.0:1788813293.286251:0:16041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813293.286277:0:16041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd400/0x1b294f297b1ed5ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2ed6 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813293.286360:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed606 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813293.286376:0:16041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed606 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813293.286392:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed606 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813293.286436:0:16041:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788813293.286440:0:16041:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813293.286462:0:16041:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed606 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813293.286492:0:16041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd400/0x1b294f297b1ed5ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ed6 expref: 8 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813293.286514:0:16041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed606 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ed6 expref: 7 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813293.286547:0:16041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef19f1fd00) 00010000:00010000:1.0:1788813293.286550:0:16041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813293.286554:0:16041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fcc00, rc 0) 00000100:00100000:1.0:1788813293.286670:0:16041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eedc6376-ef6e-4238-8e03-0517eb7ab48c+7:13901:x1875706308048512:12345-192.168.203.13@tcp:101:mkdir.0 Request processed in 449us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813293.286678:0:16041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00010000:00010000:2.0:1788813293.342045:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813294.238172:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813294.238208:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322715008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813294.238301:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813294.240369:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322715008 00000100:00100000:2.0:1788813294.240388:0:15047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322715008 00000100:00100000:2.0:1788813294.240504:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788813294.240517:0:15047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322715008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813294.240550:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813294.240665:0:15047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322715008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (2363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813294.240696:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788813294.240769:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322715008:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788813294.241305:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788813294.365104:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813295.389376:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788813295.648475:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:1.0:1788813295.824114:0:5856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of eedc6376-ef6e-4238-8e03-0517eb7ab48c 00000001:00100000:1.0:1788813295.824137:0:5856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6a4682b5-f19d-455b-8e64-4014cc43b65c 00000001:02000400:2.0:1788813296.333978:0:16324:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788813296.414664:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813296.797047:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788813296.797078:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322715136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813296.797187:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813296.799564:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788813296.799589:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3302:1875706322715264:0@lo:400:kworker.0 00000100:00100000:0.0:1788813296.799688:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813296.799758:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322715264 00000100:00100000:0.0:1788813296.799769:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322715264 00000100:00100000:0.0:1788813296.799843:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788813296.799852:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2101a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:3302:x1875706322715264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813296.799906:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2101a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:3302:x1875706322715264:12345-0@lo:400:kworker.0 Request processed in 56us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813296.799913:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788813296.799967:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3302:1875706322715264:0@lo:400:kworker.0 00000100:00100000:0.0:1788813296.800003:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322715392:0@lo:400:kworker.0 00000100:00100000:0.0:1788813296.800031:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813296.800087:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322715520:0@lo:400:kworker.0 00000100:00100000:0.0:1788813296.800116:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813296.800147:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322715520 00000100:00100000:0.0:1788813296.800151:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322715520 00000100:00100000:0.0:1788813296.800181:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788813296.800189:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322715520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813296.800226:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322715520:12345-0@lo:400:kworker.0 Request processed in 38us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813296.800233:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788813296.800268:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322715520:0@lo:400:kworker.0 00000100:00100000:0.0:1788813296.800298:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813296.800305:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322715648:0@lo:400:kworker.0 00000100:00100000:2.0:1788813296.800306:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322715136 00000100:00100000:2.0:1788813296.800310:0:15047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322715136 00000100:00100000:0.0:1788813296.800347:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813296.800361:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788813296.800369:0:15047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322715136:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813296.800391:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322715648 00000100:00100000:0.0:1788813296.800395:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322715648 00002000:00000024:2.0:1788813296.800401:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813296.800421:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788813296.800427:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322715648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813296.800446:0:15047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322715136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (3271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813296.800453:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788813296.800454:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875706322715648:12345-0@lo:400:kworker.0 Request processed in 28us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813296.800460:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788813296.800483:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1875706322715648:0@lo:400:kworker.0 00000100:00100000:0.0:1788813296.800496:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788813296.800513:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322715136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813296.800543:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322715392 00000100:00100000:0.0:1788813296.800545:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322715776:0@lo:400:kworker.0 00000100:00100000:2.0:1788813296.800547:0:15043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322715392 00000100:00100000:0.0:1788813296.800569:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813296.800575:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788813296.800581:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322715392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813296.800612:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322715776 00000100:00100000:0.0:1788813296.800616:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322715776 00000100:00100000:0.0:1788813296.800644:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788813296.800650:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875706322715776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813296.800682:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875706322715776:12345-0@lo:400:kworker.0 Request processed in 33us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813296.800688:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788813296.800713:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322715776:0@lo:400:kworker.0 00000100:00080000:0.0:1788813296.800760:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788813296.800766:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788813296.800768:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813296.801455:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322715392:12345-0@lo:400:kworker.0 Request processed in 676us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813296.801465:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788813296.801473:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322715392:0@lo:400:kworker.0 00000001:00100000:3.0:1788813296.878460:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of eedc6376-ef6e-4238-8e03-0517eb7ab48c 00010000:00010000:1.0:1788813297.438556:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813298.123540:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813298.123593:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813298.123621:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813298.123658:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813298.123688:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813298.123704:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813298.123724:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813298.123826:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308049024 00000100:00100000:1.0:1788813298.123837:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308049024 00000100:00100000:1.0:1788813298.123893:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308049280 00000100:00100000:1.0:1788813298.123896:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308049280 00000100:00100000:1.0:1788813298.123911:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308048896 00000100:00100000:1.0:1788813298.123914:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308048896 00000100:00100000:1.0:1788813298.123925:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308049408 00000100:00100000:1.0:1788813298.123927:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308049408 00000100:00100000:1.0:1788813298.123942:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:1.0:1788813298.123952:0:15044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+5:2364:x1875706308049024:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813298.124046:0:15044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+5:2364:x1875706308049024:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 95us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813298.124069:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:1.0:1788813298.124087:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1788813298.124093:0:15044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eedc6376-ef6e-4238-8e03-0517eb7ab48c+5:2364:x1875706308049280:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813298.124120:0:15044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eedc6376-ef6e-4238-8e03-0517eb7ab48c+5:2364:x1875706308049280:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 27us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813298.124126:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1788813298.124136:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:1.0:1788813298.124142:0:15044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+5:2364:x1875706308048896:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813298.124164:0:15044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+5:2364:x1875706308048896:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 21us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813298.124169:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:1.0:1788813298.124179:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:1.0:1788813298.124185:0:15044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eedc6376-ef6e-4238-8e03-0517eb7ab48c+5:2364:x1875706308049408:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813298.124209:0:15044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eedc6376-ef6e-4238-8e03-0517eb7ab48c+5:2364:x1875706308049408:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 24us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813298.124214:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:0.0:1788813298.124580:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308048768 00000100:00100000:0.0:1788813298.124597:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308048768 00000100:00100000:0.0:1788813298.124640:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308049152 00000100:00100000:0.0:1788813298.124644:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308049152 00000100:00100000:0.0:1788813298.124670:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:0.0:1788813298.124679:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+6:2364:x1875706308048768:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813298.124715:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+6:2364:x1875706308048768:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 38us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813298.124722:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:0.0:1788813298.124737:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:0.0:1788813298.124743:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eedc6376-ef6e-4238-8e03-0517eb7ab48c+6:2364:x1875706308049152:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813298.124766:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eedc6376-ef6e-4238-8e03-0517eb7ab48c+6:2364:x1875706308049152:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 24us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813298.124772:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00080000:3.0:1788813298.125545:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788813298.125552:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788813298.125554:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813298.126106:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308048640 00000100:00100000:3.0:1788813298.126116:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308048640 00000100:00100000:3.0:1788813298.126225:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 103 00000100:00100000:3.0:1788813298.126234:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2101b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd9f5279-f53e-4261-be49-522548830288+13:2364:x1875706308048640:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813298.126293:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2101b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd9f5279-f53e-4261-be49-522548830288+13:2364:x1875706308048640:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 60us (2634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813298.126317:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 103 00010000:00010000:1.0:1788813298.461101:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813299.357100:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788813299.357124:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322715904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813299.357197:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813299.357372:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322715904 00000100:00100000:2.0:1788813299.357380:0:15047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322715904 00000100:00100000:2.0:1788813299.357442:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788813299.357451:0:15047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322715904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813299.357483:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813299.357662:0:15047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322715904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813299.357670:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788813299.357747:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813299.357810:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322715904:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788813299.486223:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788813299.646135:0:16474:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffccd108380 20000000:00000080:2.0:1788813299.646154:0:16474:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93ee04908c00 uarg=0000000000000000 20000000:01000000:2.0:1788813299.646188:0:16474:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788813299.646194:0:16474:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788813299.646198:0:16474:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788813299.647181:0:16475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788813299.647438:0:16474:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788813299.664432:0:16474:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788813299.664463:0:16474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93ef1164f000/0x1b294f297b1ed60d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813299.664482:0:16474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef354fda00/0x1b294f297b1ed304 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed2fd expref: 18 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813299.664491:0:16474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef01516e00/0x1b294f297b1ed351 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed34a expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813299.664498:0:16474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef190cfe00/0x1b294f297b1ed48c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed485 expref: 18 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813299.664507:0:16474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef190ce600/0x1b294f297b1ed5ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2e4a expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813299.664514:0:16474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93ef1164e800/0x1b294f297b1ed5e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2eac expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813299.664522:0:16474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93ef1164f000/0x1b294f297b1ed60d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813299.664567:0:16474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef1164e800/0x1b294f297b1ed5e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2eac expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813299.664664:0:16474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ef1164e800/0x1b294f297b1ed5e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2eac expref: 12 pid: 14352 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813299.664680:0:16474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36161c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1875706322716032:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788813299.664896:0:16474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef190ce600/0x1b294f297b1ed5ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2e4a expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813299.664905:0:16474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ef190ce600/0x1b294f297b1ed5ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2e4a expref: 12 pid: 14352 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813299.665041:0:16474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36163b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1875706322716160:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788813299.665077:0:16474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef190cfe00/0x1b294f297b1ed48c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ed485 expref: 18 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813299.665086:0:16474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ef190cfe00/0x1b294f297b1ed48c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ed485 expref: 18 pid: 14354 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813299.665096:0:16474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36161180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1875706322716288:0@lo:104: 00000100:00100000:2.0:1788813299.665135:0:16474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788813299.665179:0:16474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef01516e00/0x1b294f297b1ed351 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ed34a expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813299.665188:0:16474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ef01516e00/0x1b294f297b1ed351 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ed34a expref: 18 pid: 14353 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813299.665196:0:16474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36163480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1875706322716416:0@lo:104: 00000100:00100000:2.0:1788813299.665218:0:16474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788813299.665259:0:16474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93ef354fda00/0x1b294f297b1ed304 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1b294f297b1ed2fd expref: 18 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813299.665267:0:16474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93ef354fda00/0x1b294f297b1ed304 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1b294f297b1ed2fd expref: 18 pid: 14352 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813299.665274:0:16474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee07d1ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1875706322716544:0@lo:104: 00000100:00100000:2.0:1788813299.665298:0:16474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813299.665308:0:16474:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef365bd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813299.665374:0:14342:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788813299.665390:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322716288 00000100:00100000:0.0:1788813299.665398:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322716288 00000100:00100000:1.0:1788813299.665431:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322716416 00000100:00100000:1.0:1788813299.665438:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322716416 00000100:00100000:0.0:1788813299.665439:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322716544 00000100:00100000:0.0:1788813299.665444:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322716544 00000100:00100000:1.0:1788813299.665470:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813299.665481:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36160380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+5:16474:x1875706322716288:12345-0@lo:104: 00010000:00010000:1.0:1788813299.665492:0:14343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef21619600/0x1b294f297b1ed485 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ed48c expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813299.665569:0:14343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788813299.665584:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36160380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+5:16474:x1875706322716288:12345-0@lo:104: Request processed in 106us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813299.665591:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788813299.665599:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813299.665608:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef21619600/0x1b294f297b1ed485 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ed48c expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813299.665621:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788813299.665630:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619600 already unused, calling callback (ffffffffc1a8ac20) 00000100:00100000:1.0:1788813299.665632:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+4:16474:x1875706322716416:12345-0@lo:104: 10000000:00010000:0.0:1788813299.665636:0:14347:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef21619600/0x1b294f297b1ed485 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ed48c expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813299.665642:0:14343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef01517200/0x1b294f297b1ed34a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ed351 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.665648:0:14347:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef21619600/0x1b294f297b1ed485 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ed48c expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813299.665658:0:14347:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef21619600/0x1b294f297b1ed485 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ed48c expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813299.665664:0:14347:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788813299.665681:0:14343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788813299.665687:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+4:16474:x1875706322716416:12345-0@lo:104: Request processed in 59us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813299.665692:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813299.665706:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788813299.665712:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef212dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+3:16474:x1875706322716544:12345-0@lo:104: 00010000:00010000:1.0:1788813299.665719:0:14343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff93ef21618e00/0x1b294f297b1ed2fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ed304 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813299.665751:0:14343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788813299.665756:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef212dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+3:16474:x1875706322716544:12345-0@lo:104: Request processed in 45us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813299.665762:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788813299.665825:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813299.665832:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef01517200/0x1b294f297b1ed34a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ed351 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813299.665838:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef01517200 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:1.0:1788813299.665847:0:14348:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef01517200/0x1b294f297b1ed34a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ed351 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813299.665854:0:14348:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef01517200/0x1b294f297b1ed34a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ed351 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813299.665861:0:14348:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef01517200/0x1b294f297b1ed34a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ed351 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813299.665866:0:14348:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788813299.665882:0:14348:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef01517200/0x1b294f297b1ed34a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ed351 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.665895:0:14347:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef21619600/0x1b294f297b1ed485 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ed48c expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813299.665905:0:14348:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813299.665909:0:14347:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813299.665933:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef21619600/0x1b294f297b1ed485 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ed48c expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.665941:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef21619600/0x1b294f297b1ed485 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ed48c expref: -99 pid: 15761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.665953:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813299.665957:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff93ef21618e00/0x1b294f297b1ed2fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1b294f297b1ed304 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.665962:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618e00 already unused, calling callback (ffffffffc1a8ac20) 10000000:00010000:0.0:1788813299.665965:0:14347:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff93ef21618e00/0x1b294f297b1ed2fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1b294f297b1ed304 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.665982:0:14347:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff93ef21618e00/0x1b294f297b1ed2fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1b294f297b1ed304 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813299.665989:0:14347:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff93ef21618e00/0x1b294f297b1ed2fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1b294f297b1ed304 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813299.665994:0:14347:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788813299.666009:0:14347:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff93ef21618e00/0x1b294f297b1ed2fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ed304 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.666014:0:14347:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813299.666030:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef21618e00/0x1b294f297b1ed2fd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ed304 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.666037:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef21618e00/0x1b294f297b1ed2fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ed304 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.666046:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813299.666048:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813299.666050:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813299.666069:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3299:1875706322716800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813299.666101:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813299.666126:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813299.666131:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3299:1875706322716672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813299.666151:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813299.666176:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3301:1875706322716928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813299.666199:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813299.666225:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322716800 00000100:00100000:0.0:1788813299.666235:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322716800 00010000:00010000:0.0:1788813299.666255:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef190cfe00/0x1b294f297b1ed48c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ed485 expref: 19 pid: 14354 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813299.666269:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322716672 00000100:00100000:0.0:1788813299.666272:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322716672 00010000:00010000:0.0:1788813299.666283:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef01516e00/0x1b294f297b1ed351 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ed34a expref: 20 pid: 14353 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813299.666292:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322716928 00000100:00100000:0.0:1788813299.666294:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322716928 00010000:00010000:0.0:1788813299.666302:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef354fda00/0x1b294f297b1ed304 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ed2fd expref: 21 pid: 14352 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813299.666313:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788813299.666320:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+21:3299:x1875706322716800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813299.666330:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813299.666334:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef190cfe00/0x1b294f297b1ed48c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ed485 expref: 21 pid: 14354 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.666343:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef190cfe00/0x1b294f297b1ed48c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ed485 expref: 21 pid: 14354 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.666357:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813299.666386:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+21:3299:x1875706322716800:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813299.666392:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788813299.666405:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788813299.666411:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+20:3299:x1875706322716672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813299.666419:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813299.666430:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef01516e00/0x1b294f297b1ed351 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ed34a expref: 20 pid: 14353 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.666437:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef01516e00/0x1b294f297b1ed351 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ed34a expref: 20 pid: 14353 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.666447:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813299.666469:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+20:3299:x1875706322716672:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (318us total) trans 0 rc 0/0 00010000:00010000:2.0:1788813299.666761:0:16474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef190cfe00/0x1b294f297b1ed48c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ed485 expref: 20 pid: 14354 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813299.666772:0:16474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36161180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1875706322716288:0@lo:104: 00010000:00010000:2.0:1788813299.666798:0:16474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef01516e00/0x1b294f297b1ed351 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ed34a expref: 19 pid: 14353 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813299.666807:0:16474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36163480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1875706322716416:0@lo:104: 00000100:00100000:2.0:1788813299.666814:0:16474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee07d1ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1875706322716544:0@lo:104: 00010000:00010000:1.0:1788813299.666879:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff93ef01517200/0x1b294f297b1ed34a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ed351 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813299.666896:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff93ef01517200/0x1b294f297b1ed34a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1b294f297b1ed351 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813299.667022:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813299.667025:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813299.667027:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813299.667034:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813299.667601:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788813299.667623:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788813299.667633:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36db2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+17:3301:x1875706322716928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813299.667645:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813299.667652:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef354fda00/0x1b294f297b1ed304 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1b294f297b1ed2fd expref: 17 pid: 14352 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.667662:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef354fda00/0x1b294f297b1ed304 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1b294f297b1ed2fd expref: 17 pid: 14352 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.667675:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef354fda00/0x1b294f297b1ed304 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1b294f297b1ed2fd expref: 17 pid: 14352 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.667747:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813299.667810:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36db2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:3301:x1875706322716928:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (1610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813299.667892:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788813299.667933:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3301:1875706322716928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813299.667965:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3299:1875706322716672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813299.667976:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3299:1875706322716800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788813299.678367:0:16474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36161c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1875706322716032:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788813299.678487:0:16474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36163b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16474:1875706322716160:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788813299.678528:0:16474:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93ef1164f000/0x1b294f297b1ed60d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813299.682074:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813299.682222:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813299.690127:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308049664 00000100:00100000:0.0:1788813299.690161:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308049664 00010000:00010000:0.0:1788813299.690210:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef190ce600/0x1b294f297b1ed5ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2e4a expref: 13 pid: 14352 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813299.690248:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308049536 00000100:00100000:0.0:1788813299.690251:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308049536 00010000:00010000:0.0:1788813299.690262:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93ef1164e800/0x1b294f297b1ed5e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2eac expref: 14 pid: 14352 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813299.690275:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:0.0:1788813299.690283:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd9f5279-f53e-4261-be49-522548830288+14:2366:x1875706308049664:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813299.690296:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813299.690301:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef190ce600/0x1b294f297b1ed5ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2e4a expref: 14 pid: 14352 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.690311:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef190ce600/0x1b294f297b1ed5ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2e4a expref: 14 pid: 14352 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.690327:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef190ce600/0x1b294f297b1ed5ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2e4a expref: 14 pid: 14352 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.690342:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813299.690400:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd9f5279-f53e-4261-be49-522548830288+13:2366:x1875706308049664:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 118us (8335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813299.690407:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:0.0:1788813299.690424:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:0.0:1788813299.690430:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd9f5279-f53e-4261-be49-522548830288+12:2365:x1875706308049536:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813299.690437:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813299.690441:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93ef1164e800/0x1b294f297b1ed5e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2eac expref: 12 pid: 14352 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.690457:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93ef1164e800/0x1b294f297b1ed5e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2eac expref: 12 pid: 14352 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.690467:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef1164e800/0x1b294f297b1ed5e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2eac expref: 12 pid: 14352 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.690478:0:14345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93ef1164f000/0x1b294f297b1ed60d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.690486:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef1164f000/0x1b294f297b1ed60d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.690502:0:14345:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ef1164f000/0x1b294f297b1ed60d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.690509:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93ef1164f000/0x1b294f297b1ed60d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.690516:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93ef1164f000/0x1b294f297b1ed60d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.690523:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93ef1164f000/0x1b294f297b1ed60d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.690529:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f000 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813299.690533:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93ef1164f000/0x1b294f297b1ed60d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.690541:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93ef1164f000/0x1b294f297b1ed60d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.690579:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93ef1164f000/0x1b294f297b1ed60d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813299.690591:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813299.690614:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd9f5279-f53e-4261-be49-522548830288+11:2365:x1875706308049536:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 183us (8391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813299.690620:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00010000:00010000:2.0:1788813299.691127:0:16474:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93ef1164f000/0x1b294f297b1ed60d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813299.691137:0:16474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93ef1164f000/0x1b294f297b1ed60d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813299.691155:0:16474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93ef1164f000/0x1b294f297b1ed60d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813300.513898:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813301.389096:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813301.389200:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308049792 00000100:00100000:0.0:1788813301.389210:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308049792 00000100:00100000:0.0:1788813301.389254:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 104 00000100:00100000:0.0:1788813301.389263:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2101a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+11:13754:x1875706308049792:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813301.389278:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813301.389296:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef190ce200/0x1b294f297b1ed614 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2edd expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813301.389324:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef190ce200/0x1b294f297b1ed614 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2edd expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813301.389335:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef190ce200/0x1b294f297b1ed614 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2edd expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813301.389345:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190ce200, rc 0) 00000100:00100000:0.0:1788813301.389706:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2101a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+12:13754:x1875706308049792:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 140us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813301.389716:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 104 00000100:00100000:3.0:1788813301.391534:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813301.391601:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308049920 00000100:00100000:1.0:1788813301.391611:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308049920 00000100:00100000:1.0:1788813301.391662:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 105 00000100:00100000:1.0:1788813301.391671:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd9f5279-f53e-4261-be49-522548830288+12:13754:x1875706308049920:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813301.392541:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd9f5279-f53e-4261-be49-522548830288+12:13754:x1875706308049920:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 867us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813301.392552:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 105 00000100:00100000:2.0:1788813301.398573:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813301.399200:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308050048 00000100:00100000:0.0:1788813301.399212:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308050048 00000100:00100000:0.0:1788813301.399281:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 106 00000100:00100000:0.0:1788813301.399292:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef2101a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+12:13754:x1875706308050048:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813301.401208:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef2101a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+12:13754:x1875706308050048:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 242us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813301.401222:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 106 00000100:00100000:2.0:1788813301.412061:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813301.413279:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308050176 00000100:00100000:1.0:1788813301.413295:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308050176 00000100:00100000:1.0:1788813301.413358:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 107 00000100:00100000:1.0:1788813301.413370:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef21018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd9f5279-f53e-4261-be49-522548830288+12:13754:x1875706308050176:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813301.413389:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813301.413528:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef354fd200/0x1b294f297b1ed61b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2ee4 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813301.413558:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef354fd200/0x1b294f297b1ed61b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ee4 expref: 13 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813301.413582:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef354fd200/0x1b294f297b1ed61b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ee4 expref: 13 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813301.413590:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fd200, rc 0) 00000100:00100000:1.0:1788813301.413659:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef21018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd9f5279-f53e-4261-be49-522548830288+13:13754:x1875706308050176:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 290us (1605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813301.413666:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 107 00000100:00100000:2.0:1788813301.421015:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813301.421348:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308050304 00000100:00100000:0.0:1788813301.421359:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308050304 00000100:00100000:0.0:1788813301.421422:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:0.0:1788813301.421432:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+13:13754:x1875706308050304:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813301.421741:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+13:13754:x1875706308050304:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 309us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813301.421749:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:0.0:1788813301.429150:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813301.429275:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308050432 00000100:00100000:3.0:1788813301.429285:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308050432 00000100:00100000:3.0:1788813301.429344:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 109 00000100:00100000:3.0:1788813301.429354:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd9f5279-f53e-4261-be49-522548830288+13:13754:x1875706308050432:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813301.429593:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd9f5279-f53e-4261-be49-522548830288+13:13754:x1875706308050432:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 240us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813301.429601:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 109 00010000:00010000:2.0:1788813301.534235:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788813301.727634:0:14357:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788813301.727642:0:14357:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ef197e6000 from 10 10000000:01000000:1.0:1788813301.727648:0:14357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788813301.727712:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef354fc400/0x1b294f297b1ed622 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813301.727724:0:14357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef354fc400/0x1b294f297b1ed622 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813301.727747:0:14357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef354fc400/0x1b294f297b1ed622 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813301.727775:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322717056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813301.727882:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813301.727933:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef36d8cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813301.730175:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322717056 00000100:00100000:0.0:1788813301.730188:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322717056 00000100:00100000:0.0:1788813301.730243:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788813301.730253:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+16:14357:x1875706322717056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813301.730268:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813301.730285:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef190ce600/0x1b294f297b1ed629 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ed622 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813301.730311:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef190ce600/0x1b294f297b1ed629 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ed622 expref: 17 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813301.730322:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef190ce600/0x1b294f297b1ed629 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed622 expref: 17 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813301.730342:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190ce600, rc 0) 00000100:00100000:0.0:1788813301.730413:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+17:14357:x1875706322717056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (2531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813301.730419:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788813301.730497:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322717056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813301.730514:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef354fc400/0x1b294f297b1ed622 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed629 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813301.730524:0:14357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef354fc400/0x1b294f297b1ed622 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ed629 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813301.730599:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322717184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813301.730628:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813301.730662:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef36d8cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813301.730707:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322717184 00000100:00100000:0.0:1788813301.730711:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322717184 00000100:00100000:0.0:1788813301.730737:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788813301.730743:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+17:14357:x1875706322717184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813301.730998:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+17:14357:x1875706322717184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813301.731005:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788813301.731032:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322717184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813301.731055:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322717312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813301.731091:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813301.731109:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e30f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788813301.731121:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322717312 00000100:00100000:0.0:1788813301.731124:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322717312 00000100:00100000:0.0:1788813301.731155:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788813301.731161:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+17:14357:x1875706322717312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813301.731296:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+17:14357:x1875706322717312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813301.731302:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788813301.731632:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322717312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788813301.733548:0:16574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788813301.733716:0:14357:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788813301.733739:0:14357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788813301.733750:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef354fc400/0x1b294f297b1ed622 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed629 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813301.733762:0:14357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef354fc400/0x1b294f297b1ed622 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed629 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813301.733773:0:14357:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788813301.733775:0:14357:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ef3e0db800 from 10 10000000:01000000:2.0:1788813301.733778:0:14357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788813301.733830:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ed630 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813301.733850:0:14357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ed630 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813301.733861:0:14357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ed630 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813301.733883:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee07d1ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322717440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788813301.733945:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813301.733982:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef365bd540 going to sleep for 11 seconds 00000100:00100000:0.0:1788813301.735115:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322717440 00000100:00100000:0.0:1788813301.735134:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322717440 00000100:00100000:0.0:1788813301.735174:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788813301.735184:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+17:14357:x1875706322717440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813301.735198:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813301.735212:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef190cfe00/0x1b294f297b1ed637 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ed630 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813301.735237:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef190cfe00/0x1b294f297b1ed637 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ed630 expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813301.735248:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef190cfe00/0x1b294f297b1ed637 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed630 expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813301.735257:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef190cfe00, rc 0) 00000100:00100000:0.0:1788813301.735315:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+18:14357:x1875706322717440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813301.735322:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788813301.735372:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee07d1ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322717440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813301.735389:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ed630 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed637 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813301.735399:0:14357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ed630 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ed637 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813301.735454:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322717568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813301.735482:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813301.735516:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e30f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788813301.735591:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322717568 00000100:00100000:2.0:1788813301.735596:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322717568 00000100:00100000:2.0:1788813301.735627:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788813301.735635:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+18:14357:x1875706322717568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813301.735912:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+18:14357:x1875706322717568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813301.735920:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788813301.735944:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322717568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813301.735980:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322717696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813301.736097:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813301.736178:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322717696 00000100:00100000:3.0:1788813301.736183:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef11fb1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813301.736183:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322717696 00000100:00100000:2.0:1788813301.736208:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788813301.736215:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+18:14357:x1875706322717696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813301.736379:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+18:14357:x1875706322717696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813301.736387:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788813301.736427:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322717696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788813301.737618:0:16575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788813301.737912:0:14357:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788813301.737936:0:14357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788813301.737945:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ed630 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed637 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813301.737957:0:14357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef1164fc00/0x1b294f297b1ed630 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed637 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813301.737966:0:14357:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788813301.737969:0:14357:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93ef36653800 from 10 10000000:01000000:2.0:1788813301.737978:0:14357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788813301.738008:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164f600/0x1b294f297b1ed63e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813301.738016:0:14357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff93ef1164f600/0x1b294f297b1ed63e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813301.738247:0:14357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff93ef1164f600/0x1b294f297b1ed63e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813301.738270:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee07d1ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322717824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788813301.738324:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813301.738359:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef365bdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813301.738378:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322717824 00000100:00100000:2.0:1788813301.738385:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322717824 00000100:00100000:2.0:1788813301.738419:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788813301.738426:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+18:14357:x1875706322717824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813301.738437:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813301.738448:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93ef1164f400/0x1b294f297b1ed645 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b294f297b1ed63e expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813301.738597:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93ef1164f400/0x1b294f297b1ed645 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1b294f297b1ed63e expref: 19 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813301.738608:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93ef1164f400/0x1b294f297b1ed645 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1b294f297b1ed63e expref: 19 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813301.738616:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164f400, rc 0) 00000100:00100000:2.0:1788813301.738653:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:14357:x1875706322717824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 227us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813301.738668:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788813301.738710:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee07d1ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322717824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813301.738722:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff93ef1164f600/0x1b294f297b1ed63e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed645 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813301.738730:0:14357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff93ef1164f600/0x1b294f297b1ed63e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1b294f297b1ed645 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813301.738771:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee07d1ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322717952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813301.738809:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813301.738822:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef365bdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813301.741968:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322717952 00000100:00100000:1.0:1788813301.741983:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322717952 00000100:00100000:1.0:1788813301.742161:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788813301.742172:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:14357:x1875706322717952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813301.743511:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:14357:x1875706322717952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1335us (4693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813301.743524:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788813301.743631:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee07d1ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322717952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813301.743704:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322718080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813301.743751:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813301.743874:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e30fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813301.743909:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322718080 00000100:00100000:1.0:1788813301.743917:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322718080 00000100:00100000:1.0:1788813301.744077:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788813301.744086:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:14357:x1875706322718080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813301.744255:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:14357:x1875706322718080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813301.744262:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788813301.744413:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:14357:1875706322718080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788813301.745607:0:16577:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788813301.746184:0:14357:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788813301.746207:0:14357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788813301.746217:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff93ef1164f600/0x1b294f297b1ed63e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed645 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813301.746229:0:14357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff93ef1164f600/0x1b294f297b1ed63e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1b294f297b1ed645 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813301.917604:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813301.917819:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322718336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813301.917886:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813301.918000:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322718336 00000100:00100000:3.0:1788813301.918009:0:15047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322718336 00000100:00100000:3.0:1788813301.918072:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788813301.918082:0:15047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322718336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813301.918127:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813301.918172:0:15047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322718336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813301.918178:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788813301.918309:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813301.918343:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322718336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813301.918523:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813301.918533:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322718464:0@lo:400:kworker.0 00000100:00100000:0.0:1788813301.918577:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813301.918650:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322718464 00000100:00100000:3.0:1788813301.918668:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322718464 00000100:00100000:3.0:1788813301.918708:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788813301.918715:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322718464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813301.918756:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322718464:12345-0@lo:400:kworker.0 Request processed in 42us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813301.918763:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788813301.918808:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322718464:0@lo:400:kworker.0 00000100:00100000:2.0:1788813301.919391:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322718592:0@lo:400:kworker.0 00000100:00100000:2.0:1788813301.919426:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813301.919447:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322718208:0@lo:400:kworker.0 00000100:00100000:2.0:1788813301.919469:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813301.919506:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322718592 00000100:00100000:2.0:1788813301.919511:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322718592 00000100:00100000:2.0:1788813301.919548:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788813301.919554:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322718592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813301.919600:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322718592:12345-0@lo:400:kworker.0 Request processed in 46us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813301.919606:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788813301.919624:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322718208 00000100:00100000:2.0:1788813301.919628:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322718208 00000100:00100000:2.0:1788813301.919651:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788813301.919665:0:15044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322718208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813301.919692:0:15044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875706322718208:12345-0@lo:400:kworker.0 Request processed in 29us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813301.919698:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788813301.919715:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788813301.919719:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813301.919736:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322718592:0@lo:400:kworker.0 00000100:00100000:2.0:1788813301.919745:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1875706322718208:0@lo:400:kworker.0 00000100:00100000:0.0:1788813301.920806:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1875706322718720:0@lo:400:kworker.0 00000100:00100000:0.0:1788813301.920857:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813301.921717:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322718720 00000100:00100000:1.0:1788813301.921727:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322718720 00000100:00100000:1.0:1788813301.921818:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788813301.921827:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875706322718720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813301.921894:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875706322718720:12345-0@lo:400:kworker.0 Request processed in 68us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813301.921900:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788813301.921940:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1875706322718720:0@lo:400:kworker.0 00000100:00080000:3.0:1788813301.922100:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788813302.559435:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813303.195396:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813303.195512:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308050560 00000100:00100000:0.0:1788813303.195523:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308050560 00000100:00100000:0.0:1788813303.195617:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:0.0:1788813303.195628:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+6:14411:x1875706308050560:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813303.195649:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813303.195673:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1ed64c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2eeb expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.195762:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618e00/0x1b294f297b1ed653 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.195777:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618e00/0x1b294f297b1ed653 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.195813:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618e00/0x1b294f297b1ed653 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.195830:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619600/0x1b294f297b1ed65a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.195838:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619600/0x1b294f297b1ed65a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.195845:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619600/0x1b294f297b1ed65a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.196158:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ed661 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.196167:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ed661 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.196175:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ed661 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813303.196201:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000100:00080000:3.0:1788813303.196303:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1788813303.196337:0:14360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788813303.196379:0:14360:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ed661 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.196400:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618e00/0x1b294f297b1ed653 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.196406:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618e00/0x1b294f297b1ed653 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.196412:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618e00/0x1b294f297b1ed653 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.196418:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21618e00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813303.196422:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618e00/0x1b294f297b1ed653 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.196429:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618e00/0x1b294f297b1ed653 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.196440:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef19f1fd00) 00010000:00010000:0.0:1788813303.196443:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813303.196447:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618e00/0x1b294f297b1ed653 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.196452:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618e00/0x1b294f297b1ed653 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.196463:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619600/0x1b294f297b1ed65a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.196469:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619600/0x1b294f297b1ed65a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.196474:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619600/0x1b294f297b1ed65a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.196484:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813303.196487:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619600/0x1b294f297b1ed65a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.196493:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619600/0x1b294f297b1ed65a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.196500:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93ef1a079900) 00010000:00010000:0.0:1788813303.196502:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813303.196504:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619600/0x1b294f297b1ed65a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.196510:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619600/0x1b294f297b1ed65a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.196542:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef190cf200/0x1b294f297b1ed64c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2eeb expref: 8 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.196569:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21618c00/0x1b294f297b1ed661 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2eeb expref: 7 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.196576:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93ef1a079400) 00010000:00010000:0.0:1788813303.196578:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788813303.196580:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21618c00, rc 0) 00000100:00100000:0.0:1788813303.196653:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+7:14411:x1875706308050560:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1026us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813303.196660:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:3.0:1788813303.200193:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813303.200364:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308050816 00000100:00100000:1.0:1788813303.200374:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308050816 00000100:00100000:1.0:1788813303.200431:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:1.0:1788813303.200441:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+7:14411:x1875706308050816:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813303.200461:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813303.200481:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ed668 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2ef2 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.200582:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ed66f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.200597:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ed66f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.200610:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ed66f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.202207:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ed676 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.202227:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ed676 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.202238:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ed676 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.204380:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ed67d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.204397:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ed67d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.204406:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ed67d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813303.204415:0:14361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788813303.204616:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ed66f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.204635:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ed66f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.204641:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ed66f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.204647:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fce00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813303.204651:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ed66f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.204658:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ed66f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.204671:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93ef1a079400) 00010000:00010000:1.0:1788813303.204674:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813303.204679:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ed66f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.204685:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ed66f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.205944:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ed676 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.205960:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ed676 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.206052:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ed676 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.206058:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fd800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813303.206072:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ed676 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.206080:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ed676 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.206097:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93ef19f1f400) 00010000:00010000:1.0:1788813303.206100:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813303.206104:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ed676 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.206111:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fd800/0x1b294f297b1ed676 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.206677:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ed668 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ef2 expref: 10 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.206696:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc000/0x1b294f297b1ed67d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ef2 expref: 9 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.206713:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ef19f1f000) 00010000:00010000:1.0:1788813303.206715:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813303.206717:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fc000, rc 0) 00000100:00100000:1.0:1788813303.206837:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+9:14411:x1875706308050816:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 6388us (6644us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788813303.206850:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:1.0:1788813303.212478:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813303.212634:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308050944 00000100:00100000:0.0:1788813303.212655:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308050944 00000100:00100000:0.0:1788813303.212862:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:0.0:1788813303.212874:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+9:14411:x1875706308050944:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788813303.212980:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+9:14411:x1875706308050944:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 Request processed in 108us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813303.212987:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:2.0:1788813303.248261:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813303.248304:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813303.248336:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813303.248363:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813303.248387:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813303.248410:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813303.248431:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308051328 00000100:00100000:2.0:1788813303.248441:0:15045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308051328 00000100:00100000:2.0:1788813303.248490:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308051584 00000100:00100000:2.0:1788813303.248493:0:15045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308051584 00000100:00100000:2.0:1788813303.248504:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308051200 00000100:00100000:2.0:1788813303.248506:0:15045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308051200 00000100:00100000:2.0:1788813303.248517:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308051712 00000100:00100000:2.0:1788813303.248519:0:15045:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308051712 00000100:00100000:2.0:1788813303.248534:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:2.0:1788813303.248542:0:15045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+5:2364:x1875706308051328:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788813303.248623:0:15045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+5:2364:x1875706308051328:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 81us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813303.248647:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:2.0:1788813303.248664:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:2.0:1788813303.248670:0:15045:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eedc6376-ef6e-4238-8e03-0517eb7ab48c+5:2364:x1875706308051584:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813303.248948:0:15043:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788813303.248958:0:15043:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788813303.249199:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:3.0:1788813303.249208:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+5:2364:x1875706308051200:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813303.249238:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+5:2364:x1875706308051200:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 32us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813303.249244:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:3.0:1788813303.249257:0:15043:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788813303.249264:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:3.0:1788813303.249270:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eedc6376-ef6e-4238-8e03-0517eb7ab48c+5:2364:x1875706308051712:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813303.249291:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eedc6376-ef6e-4238-8e03-0517eb7ab48c+5:2364:x1875706308051712:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 22us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813303.249297:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00080000:3.0:1788813303.249389:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788813303.249393:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813303.249404:0:16041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308051456 00000100:00100000:3.0:1788813303.249414:0:16041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308051456 00000100:00100000:3.0:1788813303.249451:0:16041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:3.0:1788813303.249457:0:16041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eedc6376-ef6e-4238-8e03-0517eb7ab48c+6:2364:x1875706308051456:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813303.249487:0:16041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eedc6376-ef6e-4238-8e03-0517eb7ab48c+6:2364:x1875706308051456:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 30us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813303.249494:0:16041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00080000:3.0:1788813303.249509:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813303.249935:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308051072 00000100:00100000:1.0:1788813303.249942:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308051072 00000100:00100000:1.0:1788813303.249974:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:1.0:1788813303.249999:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd9f5279-f53e-4261-be49-522548830288+13:2364:x1875706308051072:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788813303.250143:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd9f5279-f53e-4261-be49-522548830288+13:2364:x1875706308051072:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 155us (1890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813303.250151:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:2.0:1788813303.250825:0:15045:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eedc6376-ef6e-4238-8e03-0517eb7ab48c+5:2364:x1875706308051584:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 32us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813303.250886:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:3.0:1788813303.270201:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813303.270603:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308051840 00000100:00100000:2.0:1788813303.270614:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308051840 00000100:00100000:2.0:1788813303.270684:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:2.0:1788813303.270695:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+9:14417:x1875706308051840:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813303.270715:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813303.270738:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed68b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2ef9 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.270836:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed692 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.270850:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed692 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.270863:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed692 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.270877:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e400/0x1b294f297b1ed699 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.270885:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e400/0x1b294f297b1ed699 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.270907:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e400/0x1b294f297b1ed699 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.271089:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed692 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.271109:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed692 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.271115:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed692 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.271122:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164ec00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813303.271126:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed692 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.271133:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed692 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.271145:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef19f1fd00) 00010000:00010000:2.0:1788813303.271148:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813303.271153:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed692 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.271160:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed692 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.271172:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e400/0x1b294f297b1ed699 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.271177:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e400/0x1b294f297b1ed699 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.271191:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e400/0x1b294f297b1ed699 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.271197:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e400 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813303.271200:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e400/0x1b294f297b1ed699 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.271206:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e400/0x1b294f297b1ed699 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.271213:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93ef077f6c00) 00010000:00010000:2.0:1788813303.271215:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813303.271218:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e400/0x1b294f297b1ed699 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.271224:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e400/0x1b294f297b1ed699 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.271254:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed68b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ef9 expref: 10 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.271264:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef19f1fd00) 00010000:00010000:2.0:1788813303.271266:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813303.271269:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed68b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ef9 expref: 10 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.271279:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164f200, rc 0) 00000100:00100000:2.0:1788813303.271344:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+9:14417:x1875706308051840:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 650us (1152us total) trans 0 rc 301/301 00000100:00100000:2.0:1788813303.271360:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:3.0:1788813303.276502:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813303.276627:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308051968 00000100:00100000:0.0:1788813303.276637:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308051968 00000100:00100000:0.0:1788813303.276713:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:0.0:1788813303.276724:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6a4682b5-f19d-455b-8e64-4014cc43b65c+9:14417:x1875706308051968:12345-192.168.203.13@tcp:700:lfs.0 00000100:00100000:0.0:1788813303.277045:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6a4682b5-f19d-455b-8e64-4014cc43b65c+9:14417:x1875706308051968:12345-192.168.203.13@tcp:700:lfs.0 Request processed in 321us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813303.277053:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:1.0:1788813303.288408:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813303.288741:0:16041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308052224 00000100:00100000:3.0:1788813303.288752:0:16041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308052224 00000100:00100000:3.0:1788813303.288850:0:16041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:3.0:1788813303.288861:0:16041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a4682b5-f19d-455b-8e64-4014cc43b65c+9:14417:x1875706308052224:12345-192.168.203.13@tcp:36:lfs.0 00010000:00010000:3.0:1788813303.288913:0:16041:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813303.288939:0:16041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc600/0x1b294f297b1ed5ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2e74 expref: 9 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813303.288959:0:16041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef19f1fd00) 00010000:00010000:3.0:1788813303.288964:0:16041:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813303.290371:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ed6a0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813303.290394:0:16041:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed606 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ed6 expref: 5 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813303.290402:0:16041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ed6a0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813303.290450:0:16041:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed606 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ed6 expref: 5 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813303.290465:0:16041:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed606 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ed6 expref: 5 pid: 16041 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813303.290481:0:16041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16041:1875706322718848:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788813303.290584:0:16041:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef11fb1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788813303.296400:0:16041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16041:1875706322718848:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788813303.296431:0:16041:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ed6a0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813303.300873:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813303.305262:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308052352 00000100:00100000:0.0:1788813303.305284:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308052352 00010000:00010000:0.0:1788813303.305356:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed606 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ed6 expref: 6 pid: 16041 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813303.305430:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:0.0:1788813303.305443:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eedc6376-ef6e-4238-8e03-0517eb7ab48c+6:2366:x1875706308052352:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813303.305464:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813303.305473:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed606 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ed6 expref: 6 pid: 16041 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.305518:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed606 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ed6 expref: 6 pid: 16041 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.305555:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fcc00/0x1b294f297b1ed606 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2ed6 expref: 6 pid: 16041 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.305577:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef19f1fd00) 00010000:00010000:0.0:1788813303.305584:0:14345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ed6a0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.305595:0:14345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ed6a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.305743:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ed6a0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.305847:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813303.305878:0:16041:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ed6a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813303.305889:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ed6a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813303.305923:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ed6a7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813303.305932:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eedc6376-ef6e-4238-8e03-0517eb7ab48c+5:2366:x1875706308052352:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 489us (5072us total) trans 0 rc 0/0 00010000:00010000:3.0:1788813303.305938:0:16041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ed6a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813303.305945:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00010000:00010000:3.0:1788813303.305954:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ed6a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813303.310307:0:16041:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788813303.310334:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ed6a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.310346:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ed6a0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.310355:0:16041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ed6a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.310363:0:16041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214c600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813303.310368:0:16041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ed6a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.310377:0:16041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ed6a0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.310399:0:16041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef19f1fd00) 00010000:00010000:2.0:1788813303.310402:0:16041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813303.310408:0:16041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ed6a0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.310415:0:16041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214c600/0x1b294f297b1ed6a0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788813303.310441:0:16041:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d31b8909 reply state 00000000975150b6 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ed6a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813303.310452:0:16041:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788813303.311128:0:16041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a4682b5-f19d-455b-8e64-4014cc43b65c+10:14417:x1875706308052224:12345-192.168.203.13@tcp:36:lfs.0 Request processed in 22259us (22719us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788813303.311163:0:16041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00010000:00010000:3.0:1788813303.323672:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ed6a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813303.323698:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ed6a7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813303.323707:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ed6a7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813303.323732:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214d200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813303.323737:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ed6a7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813303.323747:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ed6a7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813303.323770:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93ef077b4700) 00010000:00010000:3.0:1788813303.323774:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813303.323804:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ed6a7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813303.323812:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ed6a7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813303.428505:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813303.428827:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308052480 00000100:00100000:2.0:1788813303.428841:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308052480 00000100:00100000:2.0:1788813303.428921:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:2.0:1788813303.428933:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+9:14425:x1875706308052480:12345-192.168.203.13@tcp:101:lctl.0 00010000:00010000:2.0:1788813303.428971:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813303.429002:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed6ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2f00 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.429089:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e400/0x1b294f297b1ed6b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.429106:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e400/0x1b294f297b1ed6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.429121:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e400/0x1b294f297b1ed6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813303.429165:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788813303.429170:0:14360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788813303.429216:0:14360:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e400/0x1b294f297b1ed6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.429246:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed6ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f00 expref: 11 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.429270:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e400/0x1b294f297b1ed6b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f00 expref: 10 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.429304:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef077f6c00) 00010000:00010000:2.0:1788813303.429307:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813303.429312:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164e400, rc 0) 00000100:00100000:2.0:1788813303.429391:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+10:14425:x1875706308052480:12345-192.168.203.13@tcp:101:lctl.0 Request processed in 460us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813303.429399:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:1.0:1788813303.468142:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813303.468354:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308052608 00000100:00100000:3.0:1788813303.468367:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308052608 00000100:00100000:3.0:1788813303.468443:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:3.0:1788813303.468457:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eedc6376-ef6e-4238-8e03-0517eb7ab48c+5:14426:x1875706308052608:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788813303.468484:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813303.468511:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ed6bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2f07 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813303.468608:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214da00/0x1b294f297b1ed6c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813303.468626:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214da00/0x1b294f297b1ed6c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813303.468667:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214da00/0x1b294f297b1ed6c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813303.468726:0:14361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788813303.468731:0:14361:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813303.468767:0:14361:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214da00/0x1b294f297b1ed6c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813303.468820:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ed6bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f07 expref: 7 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813303.468839:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214da00/0x1b294f297b1ed6c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f07 expref: 6 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813303.468848:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef077f6c00) 00010000:00010000:3.0:1788813303.468851:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788813303.468856:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef4214da00, rc 0) 00000100:00100000:3.0:1788813303.468926:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eedc6376-ef6e-4238-8e03-0517eb7ab48c+6:14426:x1875706308052608:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 473us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813303.468933:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:3.0:1788813303.477754:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813303.482940:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308052736 00000100:00100000:2.0:1788813303.482964:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308052736 00000100:00100000:2.0:1788813303.483055:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:2.0:1788813303.483065:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eedc6376-ef6e-4238-8e03-0517eb7ab48c+6:14426:x1875706308052736:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813303.483086:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813303.483107:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed6ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2f0e expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.483186:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed6d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.483200:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed6d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.483212:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed6d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.483227:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ed6d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.483234:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ed6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.483261:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ed6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.483930:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ed6df lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.483941:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ed6df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.483960:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ed6df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813303.483996:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788813303.484000:0:14360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788813303.484074:0:14360:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ed6df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.484090:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed6d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.484097:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed6d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.484104:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed6d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.484168:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164ec00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813303.484172:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed6d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.484181:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed6d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.484203:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef077f6c00) 00010000:00010000:2.0:1788813303.484206:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813303.484211:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed6d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.484217:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed6d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.484230:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ed6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.484236:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ed6d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.484241:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ed6d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.484246:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164ee00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813303.484248:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ed6d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.484254:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ed6d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.484260:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93ef077f6e00) 00010000:00010000:2.0:1788813303.484263:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813303.484266:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ed6d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.484271:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ed6d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.484617:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed6ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f0e expref: 8 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.484634:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ed6df lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f0e expref: 7 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.484642:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93ef077f6100) 00010000:00010000:2.0:1788813303.484644:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813303.484646:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164f800, rc 0) 00000100:00100000:2.0:1788813303.484724:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eedc6376-ef6e-4238-8e03-0517eb7ab48c+7:14426:x1875706308052736:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1660us (6978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813303.484733:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:0.0:1788813303.493288:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813303.493409:0:16041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308052992 00000100:00100000:2.0:1788813303.493419:0:16041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308052992 00000100:00100000:2.0:1788813303.493486:0:16041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:2.0:1788813303.493496:0:16041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eedc6376-ef6e-4238-8e03-0517eb7ab48c+7:14426:x1875706308052992:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813303.493517:0:16041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813303.493537:0:16041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed6e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2f15 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813303.493644:0:16041:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788813303.493766:0:16041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed6e6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f15 expref: 9 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.493815:0:16041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef077f6c00) 00010000:00010000:2.0:1788813303.493819:0:16041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813303.493838:0:16041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed6e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f15 expref: 9 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.493855:0:16041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164f200, rc 0) 00000100:00100000:2.0:1788813303.493914:0:16041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eedc6376-ef6e-4238-8e03-0517eb7ab48c+8:14426:x1875706308052992:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 419us (635us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788813303.493924:0:16041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:1.0:1788813303.507908:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813303.508162:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308053248 00000100:00100000:2.0:1788813303.508171:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308053248 00000100:00100000:2.0:1788813303.508253:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:2.0:1788813303.508262:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eedc6376-ef6e-4238-8e03-0517eb7ab48c+8:14426:x1875706308053248:12345-192.168.203.13@tcp:36:lfs.0 00010000:00010000:2.0:1788813303.508319:0:14359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813303.508346:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ed6df lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f0e expref: 8 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.508375:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93ef077f6100) 00010000:00010000:2.0:1788813303.508385:0:14359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813303.508412:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed6f4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.508423:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed6f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.508432:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed6f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788813303.509543:0:14359:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6d39e44 reply state 00000000215f85d6 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed6f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813303.509829:0:14359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788813303.509853:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788813303.510090:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eedc6376-ef6e-4238-8e03-0517eb7ab48c+9:14426:x1875706308053248:12345-192.168.203.13@tcp:36:lfs.0 Request processed in 1825us (2187us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788813303.510098:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:0.0:1788813303.513690:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813303.518459:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308053504 00000100:00100000:1.0:1788813303.518474:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308053504 00000100:00100000:1.0:1788813303.518731:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:1.0:1788813303.518746:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eedc6376-ef6e-4238-8e03-0517eb7ab48c+9:14426:x1875706308053504:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1788813303.519220:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eedc6376-ef6e-4238-8e03-0517eb7ab48c+10:14426:x1875706308053504:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 476us (5538us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788813303.519228:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00010000:00010000:2.0:1788813303.522842:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed6f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.522859:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed6f4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.522867:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed6f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.522873:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813303.522878:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed6f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.522885:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed6f4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.522901:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93ef077f6e00) 00010000:00010000:2.0:1788813303.522904:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788813303.522910:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed6f4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.522917:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed6f4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813303.523570:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813303.523811:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308053760 00000100:00100000:1.0:1788813303.523821:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308053760 00000100:00100000:1.0:1788813303.523869:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:1.0:1788813303.523879:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eedc6376-ef6e-4238-8e03-0517eb7ab48c+9:14426:x1875706308053760:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788813303.523904:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813303.523921:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ed6fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2f1c expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.524001:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed702 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.524015:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed702 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.524204:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed702 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.524221:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ed709 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.524228:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ed709 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.524236:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ed709 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813303.524347:0:14361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788813303.524698:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed702 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.524707:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed702 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.524714:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed702 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.524722:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fda00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813303.524726:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed702 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.524732:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed702 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.524743:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef077f6c00) 00010000:00010000:1.0:1788813303.524746:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813303.524759:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed702 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.524765:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed702 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.524813:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ed709 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.524820:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ed709 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.524824:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ed709 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.524830:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fdc00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:1.0:1788813303.524833:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ed709 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.524838:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ed709 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.524846:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93ef19f1f400) 00010000:00010000:1.0:1788813303.524848:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813303.524850:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ed709 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.524856:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ed709 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.524897:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ed6fb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f1c expref: 11 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.524919:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef077f6c00) 00010000:00010000:1.0:1788813303.524922:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788813303.524925:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fce00/0x1b294f297b1ed6fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f1c expref: 11 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.524936:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fce00, rc 0) 00000100:00100000:1.0:1788813303.525004:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eedc6376-ef6e-4238-8e03-0517eb7ab48c+10:14426:x1875706308053760:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1125us (1437us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788813303.525011:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:0.0:1788813303.528657:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813303.528883:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308053888 00000100:00100000:2.0:1788813303.528893:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308053888 00000100:00100000:2.0:1788813303.528944:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:2.0:1788813303.529205:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eedc6376-ef6e-4238-8e03-0517eb7ab48c+11:14426:x1875706308053888:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813303.529238:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813303.529257:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ed717 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2f23 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.529341:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ed71e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.529354:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ed71e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.529594:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ed71e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813303.529745:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788813303.529749:0:14360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788813303.529766:0:14360:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ed71e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.529869:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ed717 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f23 expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.529886:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ed71e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f23 expref: 11 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.529895:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93ef077f6100) 00010000:00010000:2.0:1788813303.529899:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813303.529902:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164ee00, rc 0) 00000100:00100000:2.0:1788813303.530461:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eedc6376-ef6e-4238-8e03-0517eb7ab48c+11:14426:x1875706308053888:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1259us (1810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813303.530482:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:1.0:1788813303.536757:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813303.536910:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308054016 00000100:00100000:0.0:1788813303.536920:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308054016 00000100:00100000:0.0:1788813303.537208:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:0.0:1788813303.537230:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eedc6376-ef6e-4238-8e03-0517eb7ab48c+11:14426:x1875706308054016:12345-192.168.203.13@tcp:37:lfs.0 00000100:00100000:2.0:1788813303.543695:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eedc6376-ef6e-4238-8e03-0517eb7ab48c+11:14426:x1875706308054016:12345-192.168.203.13@tcp:37:lfs.0 Request processed in 6457us (6937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813303.543708:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:1.0:1788813303.551744:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813303.551827:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308054272 00000100:00100000:3.0:1788813303.551837:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308054272 00000100:00100000:3.0:1788813303.553522:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:3.0:1788813303.553556:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1211f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eedc6376-ef6e-4238-8e03-0517eb7ab48c+11:14426:x1875706308054272:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1788813303.553812:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1211f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eedc6376-ef6e-4238-8e03-0517eb7ab48c+12:14426:x1875706308054272:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 277us (2074us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788813303.553837:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00010000:00010000:3.0:1788813303.580923:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813303.620233:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813303.620335:0:16041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308054400 00000100:00100000:2.0:1788813303.620345:0:16041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308054400 00000100:00100000:2.0:1788813303.620420:0:16041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:2.0:1788813303.620430:0:16041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef37fb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a4682b5-f19d-455b-8e64-4014cc43b65c+10:14432:x1875706308054400:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1788813303.620448:0:16041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813303.620468:0:16041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ed725 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2f2a expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.620525:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed72c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.620540:0:16041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed72c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.620564:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed72c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.620579:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed733 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.620586:0:16041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed733 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.620592:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed733 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.620705:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ed73a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.620714:0:16041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ed73a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.620721:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ed73a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813303.620745:0:16041:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788813303.620749:0:16041:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788813303.620815:0:16041:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ed73a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.620828:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed72c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.620834:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed72c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.620841:0:16041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed72c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.620847:0:16041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813303.620851:0:16041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed72c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.620858:0:16041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed72c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.620870:0:16041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef077f6c00) 00010000:00010000:2.0:1788813303.620878:0:16041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813303.620884:0:16041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed72c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.620891:0:16041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed72c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.620905:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed733 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.620912:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed733 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.620918:0:16041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed733 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.620923:0:16041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164ec00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813303.620926:0:16041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed733 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.620932:0:16041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed733 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.620939:0:16041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93ef077f6e00) 00010000:00010000:2.0:1788813303.620941:0:16041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813303.620944:0:16041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed733 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.620950:0:16041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed733 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.620978:0:16041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ed725 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f2a expref: 12 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.621018:0:16041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164fe00/0x1b294f297b1ed73a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f2a expref: 11 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.621260:0:16041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93ef077f6100) 00010000:00010000:2.0:1788813303.621263:0:16041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788813303.621266:0:16041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164fe00, rc 0) 00000100:00100000:2.0:1788813303.621369:0:16041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef37fb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a4682b5-f19d-455b-8e64-4014cc43b65c+11:14432:x1875706308054400:12345-192.168.203.13@tcp:101:bash.0 Request processed in 941us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813303.621378:0:16041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:0.0:1788813303.625715:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813303.625881:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308054656 00000100:00100000:1.0:1788813303.625891:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308054656 00000100:00100000:1.0:1788813303.625966:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:1.0:1788813303.625977:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+11:14432:x1875706308054656:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788813303.625998:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813303.626021:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ed741 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2f31 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.626140:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed748 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.626156:0:14361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ed71e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f23 expref: 11 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.626183:0:14361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed748 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.626220:0:14361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ed71e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f23 expref: 11 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.626233:0:14361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ed71e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f23 expref: 11 pid: 14360 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813303.626246:0:14361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef37fb7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14361:1875706322718976:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788813303.626381:0:14361:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef10237900 going to sleep for 11 seconds 00000100:00100000:1.0:1788813303.636249:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813303.637455:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308054784 00000100:00100000:0.0:1788813303.637467:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308054784 00010000:00010000:0.0:1788813303.637512:0:14344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ed71e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f23 expref: 12 pid: 14360 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813303.637567:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:0.0:1788813303.637577:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eedc6376-ef6e-4238-8e03-0517eb7ab48c+12:2366:x1875706308054784:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813303.637592:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813303.637599:0:14344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ed71e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f23 expref: 12 pid: 14360 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.637613:0:14344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ed71e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f23 expref: 12 pid: 14360 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.637635:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93ef077f6100) 00010000:00010000:0.0:1788813303.637641:0:14344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed748 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.637651:0:14344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed748 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.637659:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed748 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.637677:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813303.637733:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eedc6376-ef6e-4238-8e03-0517eb7ab48c+12:2366:x1875706308054784:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 158us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813303.637757:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00010000:00010000:3.0:1788813303.641585:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ee00/0x1b294f297b1ed71e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f23 expref: 11 pid: 14360 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813303.641613:0:14361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef37fb7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14361:1875706322718976:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788813303.641640:0:14361:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed748 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.646078:0:14361:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed748 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.646095:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed748 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.646127:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ed74f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.646140:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ed74f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.646151:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ed74f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.648174:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed756 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.648194:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed756 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.648223:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed756 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813303.648236:0:14361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788813303.648264:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed748 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.648272:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed748 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.648278:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed748 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.648285:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fda00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813303.648289:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed748 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.648296:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed748 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.648308:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93ef077f6100) 00010000:00010000:2.0:1788813303.648310:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813303.648315:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed748 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.648322:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed748 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788813303.648338:0:14361:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e1420ea reply state 000000007853d6d1 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ed74f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813303.648357:0:14361:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788813303.648394:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ed741 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f31 expref: 14 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.648408:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed756 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f31 expref: 13 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.648415:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ef077f6300) 00010000:00010000:2.0:1788813303.648417:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788813303.648419:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164ec00, rc 0) 00000100:00100000:2.0:1788813303.648502:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+14:14432:x1875706308054656:12345-192.168.203.13@tcp:101:bash.0 Request processed in 22526us (22796us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788813303.648510:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00010000:00010000:3.0:1788813303.654197:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ed74f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813303.654212:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ed74f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813303.654219:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ed74f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813303.654225:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f800 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813303.654230:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ed74f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813303.654238:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ed74f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813303.654255:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93ef077f6e00) 00010000:00010000:3.0:1788813303.654259:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813303.654264:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ed74f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813303.654289:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f800/0x1b294f297b1ed74f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813303.669869:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813303.669964:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308054912 00000100:00100000:1.0:1788813303.669975:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308054912 00000100:00100000:1.0:1788813303.670046:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:1.0:1788813303.670056:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+13:14432:x1875706308054912:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788813303.670080:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813303.670102:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ed764 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2f38 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.670167:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed76b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.670181:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed76b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.670193:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed76b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813303.670248:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788813303.670253:0:14359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813303.670275:0:14359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed76b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.670286:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed76b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.670312:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fdc00/0x1b294f297b1ed764 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f38 expref: 15 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.670330:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed76b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f38 expref: 14 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813303.670338:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ef077f6300) 00010000:00010000:1.0:1788813303.670341:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813303.670345:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fda00, rc 0) 00000100:00100000:1.0:1788813303.670610:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+14:14432:x1875706308054912:12345-192.168.203.13@tcp:101:bash.0 Request processed in 547us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813303.670618:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:1.0:1788813303.676331:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813303.676601:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308055168 00000100:00100000:2.0:1788813303.676611:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308055168 00000100:00100000:2.0:1788813303.676671:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:2.0:1788813303.676682:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+14:14432:x1875706308055168:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:0.0:1788813303.677300:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+15:14432:x1875706308055168:12345-192.168.203.13@tcp:35:bash.0 Request processed in 617us (977us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788813303.677310:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:0.0:1788813303.806064:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813303.806245:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308055424 00000100:00100000:2.0:1788813303.806255:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308055424 00000100:00100000:2.0:1788813303.806316:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:2.0:1788813303.806325:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+15:14442:x1875706308055424:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788813303.806346:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813303.806374:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed772 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2f3f expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813303.806461:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788813303.806613:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed772 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f3f expref: 17 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.806629:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93ef077f6c00) 00010000:00010000:2.0:1788813303.806632:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813303.806636:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed772 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f3f expref: 17 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.806651:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164f200, rc 0) 00000100:00100000:2.0:1788813303.806716:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+16:14442:x1875706308055424:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 392us (660us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788813303.806724:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:1.0:1788813303.811093:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813303.811222:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308055680 00000100:00100000:0.0:1788813303.811231:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308055680 00000100:00100000:0.0:1788813303.811293:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:0.0:1788813303.811302:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+16:14442:x1875706308055680:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1788813303.811566:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+17:14442:x1875706308055680:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 264us (481us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788813303.811574:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000040:00080000:3.0:1788813303.840081:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788813303.864854:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813303.865095:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308055936 00000100:00100000:0.0:1788813303.865106:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308055936 00000100:00100000:0.0:1788813303.865169:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:0.0:1788813303.865179:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+17:14445:x1875706308055936:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788813303.865205:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813303.865227:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ed780 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2f46 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.865323:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619400/0x1b294f297b1ed787 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.865337:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619400/0x1b294f297b1ed787 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.865369:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619400/0x1b294f297b1ed787 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813303.865384:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788813303.865520:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ed780 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f46 expref: 20 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.865539:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619400/0x1b294f297b1ed787 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f46 expref: 19 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813303.865557:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ef077f6300) 00010000:00010000:0.0:1788813303.865560:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813303.865564:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619400, rc 0) 00000100:00100000:0.0:1788813303.866084:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+19:14445:x1875706308055936:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 896us (1228us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788813303.866092:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:1.0:1788813303.869275:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813303.869368:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308056064 00000100:00100000:2.0:1788813303.869379:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308056064 00000100:00100000:2.0:1788813303.869443:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:2.0:1788813303.869454:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+19:14445:x1875706308056064:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:2.0:1788813303.869519:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed795 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.869535:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed795 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.869556:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed795 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.869585:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed795 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.869592:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed795 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.869612:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed795 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.869619:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813303.869623:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed795 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.869631:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed795 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.869653:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ef077f6300) 00010000:00010000:2.0:1788813303.869656:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813303.869660:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed795 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.869666:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed795 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813303.869747:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+19:14445:x1875706308056064:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 294us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813303.869755:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:1.0:1788813303.873177:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813303.873210:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813303.873294:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308056448 00000100:00100000:0.0:1788813303.873304:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308056448 00000100:00100000:2.0:1788813303.873305:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308056192 00000100:00100000:2.0:1788813303.873309:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308056192 00000100:00100000:0.0:1788813303.873359:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:0.0:1788813303.873369:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+20:14445:x1875706308056448:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788813303.873389:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:2.0:1788813303.873395:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36161180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+20:2366:x1875706308056192:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813303.873408:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813303.873430:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619400/0x1b294f297b1ed787 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f46 expref: 20 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813303.873464:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ef077f6300) 00010000:00010000:2.0:1788813303.873469:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813303.873519:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36161180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+20:2366:x1875706308056192:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 124us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813303.873525:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:0.0:1788813303.873553:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+19:14445:x1875706308056448:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 176us (374us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788813303.873560:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1788813304.243926:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813304.244039:0:16041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308056704 00000100:00100000:2.0:1788813304.244050:0:16041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308056704 00000100:00100000:2.0:1788813304.244108:0:16041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:2.0:1788813304.244119:0:16041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a4682b5-f19d-455b-8e64-4014cc43b65c+19:14476:x1875706308056704:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:2.0:1788813304.244139:0:16041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813304.244157:0:16041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed79c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2f4d expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.244246:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ed7a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.244260:0:16041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ed7a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.244271:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ed7a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813304.244282:0:16041:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788813304.244421:0:16041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed79c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f4d expref: 22 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.244439:0:16041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ed7a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f4d expref: 21 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.244461:0:16041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ef077f6300) 00010000:00010000:2.0:1788813304.244463:0:16041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813304.244466:0:16041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164e200, rc 0) 00000100:00100000:2.0:1788813304.244527:0:16041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a4682b5-f19d-455b-8e64-4014cc43b65c+21:14476:x1875706308056704:12345-192.168.203.13@tcp:101:cat.0 Request processed in 410us (610us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788813304.244533:0:16041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:3.0:1788813304.250240:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813304.250288:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813304.250368:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308057088 00000100:00100000:2.0:1788813304.250378:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308057088 00000100:00100000:2.0:1788813304.250441:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:2.0:1788813304.250450:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+21:2364:x1875706308057088:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813304.250465:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813304.250488:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ed7a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f4d expref: 21 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.250506:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ef077f6300) 00010000:00010000:2.0:1788813304.250511:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813304.250579:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+20:2364:x1875706308057088:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 130us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813304.250586:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:0.0:1788813304.251003:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308056960 00000100:00100000:0.0:1788813304.251009:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308056960 00000100:00100000:0.0:1788813304.251043:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:0.0:1788813304.251052:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+20:14476:x1875706308056960:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:0.0:1788813304.251404:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+21:14476:x1875706308056960:12345-192.168.203.13@tcp:35:cat.0 Request processed in 352us (1171us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788813304.251411:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:3.0:1788813304.340233:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813304.340387:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308057344 00000100:00100000:1.0:1788813304.340409:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308057344 00000100:00100000:1.0:1788813304.340473:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:1.0:1788813304.340483:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+21:14482:x1875706308057344:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:1.0:1788813304.340504:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813304.340526:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc600/0x1b294f297b1ed7b1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2f54 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.340648:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ed7b8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.340661:0:14361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed756 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f31 expref: 22 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.340669:0:14361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed76b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f38 expref: 22 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.340677:0:14361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ed7b8 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.340710:0:14361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed76b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f38 expref: 22 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.340736:0:14361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed76b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f38 expref: 22 pid: 14359 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813304.340750:0:14361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36162680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14361:1875706322719104:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788813304.340879:0:14361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed756 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f31 expref: 22 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813304.340899:0:14361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed756 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f31 expref: 22 pid: 14361 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813304.340909:0:14361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36160380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14361:1875706322719232:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788813304.340934:0:14361:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef10237e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788813304.344431:0:14361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36162680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14361:1875706322719104:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788813304.344447:0:14361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36160380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14361:1875706322719232:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788813304.344471:0:14361:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ed7b8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813304.347017:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813304.347064:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813304.347375:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308057472 00000100:00100000:0.0:1788813304.347385:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308057472 00010000:00010000:0.0:1788813304.347424:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed76b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f38 expref: 23 pid: 14359 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813304.347463:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308057600 00000100:00100000:0.0:1788813304.347466:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308057600 00010000:00010000:0.0:1788813304.347478:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed756 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f31 expref: 24 pid: 14361 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813304.347494:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:0.0:1788813304.347503:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36db0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+24:2366:x1875706308057472:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813304.347515:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813304.347521:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed76b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f38 expref: 24 pid: 14359 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.347534:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed76b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f38 expref: 24 pid: 14359 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.347564:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fda00/0x1b294f297b1ed76b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f38 expref: 24 pid: 14359 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.347582:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ef077f6300) 00010000:00010000:0.0:1788813304.347586:0:14345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ed7b8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.347607:0:14345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ed7b8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.347615:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813304.347667:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36db0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+23:2366:x1875706308057472:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 165us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813304.347674:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:0.0:1788813304.347714:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:0.0:1788813304.347719:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+22:2366:x1875706308057600:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813304.347726:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813304.347730:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed756 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f31 expref: 22 pid: 14361 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.347739:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed756 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f31 expref: 22 pid: 14361 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.347750:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164ec00/0x1b294f297b1ed756 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f31 expref: 22 pid: 14361 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.347759:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ef077f6300) 00010000:00010000:0.0:1788813304.347762:0:14345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ed7b8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.347769:0:14345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ed7b8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.347776:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ed7b8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.347844:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813304.347862:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+21:2366:x1875706308057600:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 143us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813304.347867:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00010000:00010000:0.0:1788813304.347895:0:14361:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ed7b8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.347902:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ed7b8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813304.347919:0:14361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788813304.348465:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fc600/0x1b294f297b1ed7b1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f54 expref: 22 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.348481:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef354fde00/0x1b294f297b1ed7b8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f54 expref: 21 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.348488:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ef077f6300) 00010000:00010000:0.0:1788813304.348490:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788813304.348492:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef354fde00, rc 0) 00000100:00100000:0.0:1788813304.348579:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+21:14482:x1875706308057344:12345-192.168.203.13@tcp:101:dd.0 Request processed in 8097us (8354us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788813304.348586:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:3.0:1788813304.360340:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813304.360486:0:16041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308057856 00000100:00100000:2.0:1788813304.360506:0:16041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308057856 00000100:00100000:2.0:1788813304.360564:0:16041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:2.0:1788813304.360572:0:16041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a4682b5-f19d-455b-8e64-4014cc43b65c+21:14482:x1875706308057856:12345-192.168.203.13@tcp:36:dd.0 00010000:00010000:2.0:1788813304.360834:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ed7c6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.360849:0:16041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ed7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.360861:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ed7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788813304.360901:0:16041:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788813304.360943:0:16041:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000084a22cb5 reply state 0000000055e4d61f transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ed7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813304.360959:0:16041:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788813304.361417:0:16041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a4682b5-f19d-455b-8e64-4014cc43b65c+24:14482:x1875706308057856:12345-192.168.203.13@tcp:36:dd.0 Request processed in 842us (1082us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788813304.361425:0:16041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00000020:00080000:2.0:1788813304.361429:0:16041:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788813304.363345:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ed7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.363361:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ed7c6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.363369:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ed7c6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.363377:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813304.363382:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ed7c6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.363403:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ed7c6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.363420:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ef077f6300) 00010000:00010000:2.0:1788813304.363422:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813304.363427:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ed7c6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.363434:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ed7c6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813304.367442:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813304.367641:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308057984 00000100:00100000:2.0:1788813304.367653:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308057984 00000100:00100000:2.0:1788813304.367714:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:2.0:1788813304.367723:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+23:14482:x1875706308057984:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:2.0:1788813304.367747:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813304.367769:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed7cd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2f5b expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.367858:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed7cd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f5b expref: 24 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.367874:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed7cd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f5b expref: 24 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.367893:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ef077f6300) 00010000:00010000:2.0:1788813304.367897:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788813304.367900:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164f200, rc 0) 00000100:00100000:2.0:1788813304.367969:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+24:14482:x1875706308057984:12345-192.168.203.13@tcp:101:dd.0 Request processed in 246us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813304.367976:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:3.0:1788813304.386580:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813304.386684:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308058240 00000100:00100000:0.0:1788813304.386695:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308058240 00000100:00100000:0.0:1788813304.386760:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:0.0:1788813304.386770:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+24:14482:x1875706308058240:12345-192.168.203.13@tcp:103:dd.0 00010000:00010000:0.0:1788813304.386847:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813304.386873:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164f200/0x1b294f297b1ed7cd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f5b expref: 24 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.386896:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ef077f6300) 00010000:00010000:0.0:1788813304.386901:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813304.386966:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+23:14482:x1875706308058240:12345-192.168.203.13@tcp:103:dd.0 Request processed in 197us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813304.386974:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:3.0:1788813304.391979:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813304.392185:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308058368 00000100:00100000:0.0:1788813304.392197:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308058368 00000100:00100000:0.0:1788813304.392252:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:0.0:1788813304.392262:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+23:14482:x1875706308058368:12345-192.168.203.13@tcp:58:dd.0 00010000:00010000:0.0:1788813304.392357:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ed7d4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.392373:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ed7d4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.392385:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ed7d4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788813304.397618:0:14359:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813304.397777:0:14359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788813304.398504:0:14359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788813304.398759:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+23:14482:x1875706308058368:12345-192.168.203.13@tcp:58:dd.0 Request processed in 6493us (6784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813304.398770:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:3.0:1788813304.409534:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813304.409637:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308058496 00000100:00100000:2.0:1788813304.409647:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308058496 00000100:00100000:2.0:1788813304.409746:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:2.0:1788813304.409756:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+23:14482:x1875706308058496:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:2.0:1788813304.409777:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813304.409824:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ed7db lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2f62 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.409878:0:14360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ed7d4 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.409889:0:14360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ed7db lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f62 expref: 24 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.409915:0:14360:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ed7d4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.409928:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ed7db lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f62 expref: 24 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.409941:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ef077f6300) 00010000:00010000:2.0:1788813304.409944:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788813304.409948:0:14360:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ed7db lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f62 expref: 24 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.409956:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164e200, rc 0) 00000100:00100000:2.0:1788813304.410034:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+24:14482:x1875706308058496:12345-192.168.203.13@tcp:101:dd.0 Request processed in 279us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813304.410041:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:0.0:1788813304.477432:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788813304.477453:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee07d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322719360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813304.477513:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813304.477645:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322719360 00000100:00100000:2.0:1788813304.477653:0:15047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322719360 00000100:00100000:2.0:1788813304.477712:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788813304.477720:0:15047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322719360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813304.477750:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813304.477809:0:15047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875706322719360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813304.477816:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788813304.477854:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee07d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1875706322719360:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788813304.478123:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788813304.605439:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788813304.862409:0:14390:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788813304.862418:0:14390:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813304.862467:0:14390:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788813304.862475:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788813304.862609:0:14390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14390:1875706322719488:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788813304.862720:0:14390:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef212380c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813304.875232:0:14390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14390:1875706322719488:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788813304.883821:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813304.888181:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308058624 00000100:00100000:0.0:1788813304.888197:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308058624 00000100:00100000:0.0:1788813304.888263:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:0.0:1788813304.888273:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6a4682b5-f19d-455b-8e64-4014cc43b65c+24:14484:x1875706308058624:12345-192.168.203.13@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788813304.888435:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6a4682b5-f19d-455b-8e64-4014cc43b65c+24:14484:x1875706308058624:12345-192.168.203.13@tcp:900:lhsmtool_posix.0 Request processed in 163us (4659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813304.888443:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:3.0:1788813304.899326:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813304.899425:0:16041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308058752 00000100:00100000:2.0:1788813304.899446:0:16041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308058752 00000100:00100000:2.0:1788813304.899518:0:16041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:2.0:1788813304.899528:0:16041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a4682b5-f19d-455b-8e64-4014cc43b65c+24:14484:x1875706308058752:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788813304.899568:0:16041:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788813304.899687:0:16041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a4682b5-f19d-455b-8e64-4014cc43b65c+24:14484:x1875706308058752:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 161us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813304.899695:0:16041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:1.0:1788813304.905216:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813304.905398:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308058880 00000100:00100000:0.0:1788813304.905412:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308058880 00000100:00100000:0.0:1788813304.905488:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:0.0:1788813304.905500:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+24:14484:x1875706308058880:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788813304.905608:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed7e2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.905631:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed7e2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.905670:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed7e2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.905689:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed7e9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.905696:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.905704:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.905733:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed7f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.905742:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed7f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.905749:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed7f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813304.905850:0:14361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788813304.905856:0:14361:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788813304.905871:0:14361:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed7f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.905883:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed7e2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.905890:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed7e2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.905910:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed7e2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.905916:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619c00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813304.905921:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed7e2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.905930:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed7e2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.905943:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ef19f1f000) 00010000:00010000:0.0:1788813304.905947:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813304.905953:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed7e2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.905960:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed7e2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.905976:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.905992:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed7e9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.905998:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed7e9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.906003:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813304.906007:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed7e9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.906023:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed7e9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.906032:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff93ef1a079900) 00010000:00010000:0.0:1788813304.906035:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813304.906038:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed7e9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.906044:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed7e9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.906059:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed7f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.906066:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed7f0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.906072:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed7f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.906077:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619a00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813304.906080:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed7f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.906087:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed7f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.906094:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ef077f6300) 00010000:00010000:0.0:1788813304.906097:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813304.906100:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed7f0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.906115:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed7f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813304.906324:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+24:14484:x1875706308058880:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 825us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813304.906337:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:1.0:1788813304.914909:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813304.915277:0:16041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308059136 00000100:00100000:2.0:1788813304.915290:0:16041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308059136 00000100:00100000:2.0:1788813304.915366:0:16041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:2.0:1788813304.915377:0:16041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a4682b5-f19d-455b-8e64-4014cc43b65c+24:14484:x1875706308059136:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813304.915403:0:16041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813304.915448:0:16041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ed7f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2f69 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.915590:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ed7fe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.915610:0:16041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ed7fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.915624:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ed7fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813304.915639:0:16041:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788813304.915769:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ed7fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.915824:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ed7fe lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.915833:0:16041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ed7fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.915839:0:16041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:2.0:1788813304.915844:0:16041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ed7fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.915852:0:16041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ed7fe lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.915883:0:16041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ef077f6300) 00010000:00010000:2.0:1788813304.915887:0:16041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788813304.915893:0:16041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ed7fe lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.915909:0:16041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ed7fe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.915968:0:16041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ed7f7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f69 expref: 26 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.916369:0:16041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93ef19f1f000) 00010000:00010000:2.0:1788813304.916373:0:16041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813304.916378:0:16041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ed7f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f69 expref: 26 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.916391:0:16041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef1164e000, rc 0) 00000100:00100000:2.0:1788813304.916520:0:16041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a4682b5-f19d-455b-8e64-4014cc43b65c+25:14484:x1875706308059136:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1144us (1625us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1788813304.916529:0:16041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:3.0:1788813304.931635:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813304.932040:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308059264 00000100:00100000:0.0:1788813304.932056:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308059264 00000100:00100000:0.0:1788813304.932137:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:0.0:1788813304.932149:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+25:14484:x1875706308059264:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788813304.932207:0:14361:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788813304.932386:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+25:14484:x1875706308059264:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 239us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813304.932394:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:1.0:1788813304.951766:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813304.952416:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308059520 00000100:00100000:0.0:1788813304.952429:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308059520 00000100:00100000:0.0:1788813304.952507:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:0.0:1788813304.952519:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+25:14484:x1875706308059520:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813304.952555:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813304.952582:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed80c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2f70 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788813304.954860:0:14359:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:0.0:1788813304.954875:0:14359:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1788813304.954932:0:14359:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1788813304.956634:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed813 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.956670:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed813 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.956685:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed813 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.956778:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed80c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f70 expref: 28 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.958389:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed813 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f70 expref: 27 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.958426:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93ef1a079900) 00010000:00010000:0.0:1788813304.958430:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813304.958436:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619200, rc 0) 00000100:00100000:0.0:1788813304.958555:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+27:14484:x1875706308059520:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 6033us (6800us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788813304.958567:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:1.0:1788813304.964438:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813304.966386:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308059776 00000100:00100000:0.0:1788813304.966407:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308059776 00000100:00100000:0.0:1788813304.966506:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:0.0:1788813304.966519:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+27:14484:x1875706308059776:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788813304.966620:0:14361:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813304.966655:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed813 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f70 expref: 27 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.966680:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93ef1a079900) 00010000:00010000:0.0:1788813304.966709:0:14361:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813304.966737:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed821 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.966753:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed821 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.966765:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed821 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.975036:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed828 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xcdafd1cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.975060:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed828 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcdafd1cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.975073:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed828 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcdafd1cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.975150:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed821 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.975157:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed821 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.975164:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed821 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.975171:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619a00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813304.975175:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed821 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.975183:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed821 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.975212:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93ef077f6100) 00010000:00010000:0.0:1788813304.975215:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813304.975231:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed821 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.975238:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed821 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.975252:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed828 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcdafd1cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.975259:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed828 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcdafd1cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.975264:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed828 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcdafd1cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.975270:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619c00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813304.975273:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed828 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcdafd1cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.975279:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed828 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcdafd1cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.975286:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xcdafd1cb (ffff93ef1a079800) 00010000:00010000:0.0:1788813304.975288:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813304.975292:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed828 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xcdafd1cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.975298:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed828 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xcdafd1cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813304.975418:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+26:14484:x1875706308059776:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 8897us (10991us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788813304.975426:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:3.0:1788813304.980657:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813304.980837:0:16041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308059904 00000100:00100000:2.0:1788813304.980851:0:16041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308059904 00000100:00100000:3.0:1788813304.981291:0:16041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:3.0:1788813304.981304:0:16041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a4682b5-f19d-455b-8e64-4014cc43b65c+26:14484:x1875706308059904:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813304.981332:0:16041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813304.981366:0:16041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ed82f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2f77 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813304.981412:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ed836 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813304.981449:0:16041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ed836 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813304.981465:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ed836 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813304.981613:0:16041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ed82f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f77 expref: 28 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813304.981638:0:16041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d200/0x1b294f297b1ed836 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f77 expref: 27 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813304.981648:0:16041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93ef077b4100) 00010000:00010000:3.0:1788813304.981651:0:16041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788813304.981656:0:16041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef4214d200, rc 0) 00000100:00100000:3.0:1788813304.981736:0:16041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a4682b5-f19d-455b-8e64-4014cc43b65c+27:14484:x1875706308059904:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 435us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813304.981744:0:16041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:1.0:1788813304.989074:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813304.989159:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308060160 00000100:00100000:2.0:1788813304.989172:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308060160 00000100:00100000:2.0:1788813304.989238:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:2.0:1788813304.989248:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+27:14484:x1875706308060160:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788813304.989367:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ed83d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.989387:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ed83d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813304.989400:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ed83d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788813304.989938:0:14360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1788813304.989962:0:14360:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 465376180179ns, next at 466376177185ns, rc = 0 00000004:00010000:2.0:1788813304.990070:0:14360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e50037d3 reply state 0000000030ddeb81 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ed83d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813304.990081:0:14360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788813304.990193:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+29:14484:x1875706308060160:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 945us (1130us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788813304.990202:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:1.0:1788813304.998017:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00010000:00010000:3.0:1788813304.998446:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ed83d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813304.998461:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ed83d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813304.998470:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ed83d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813304.998477:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813304.998483:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ed83d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813304.998509:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ed83d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813304.998531:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93ef077b4100) 00010000:00010000:3.0:1788813304.998543:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788813304.998551:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ed83d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813304.998557:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e000/0x1b294f297b1ed83d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813304.998865:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308060288 00000100:00100000:0.0:1788813304.998880:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308060288 00000100:00100000:0.0:1788813304.998964:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:0.0:1788813304.998975:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+28:14484:x1875706308060288:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813304.999006:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813304.999029:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed844 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2f7e expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.999104:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed844 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f7e expref: 29 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.999120:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed844 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f7e expref: 29 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813304.999142:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93ef077b4100) 00010000:00010000:0.0:1788813304.999145:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788813304.999148:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619c00, rc 0) 00000100:00100000:0.0:1788813304.999227:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+29:14484:x1875706308060288:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 253us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813304.999234:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:3.0:1788813305.002692:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813305.002842:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308060416 00000100:00100000:0.0:1788813305.002855:0:15043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308060416 00000100:00100000:0.0:1788813305.002951:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:0.0:1788813305.002975:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+5:2365:x1875706308060416:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788813305.003073:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788813305.003701:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+6:2365:x1875706308060416:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 728us (1018us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788813305.003712:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:1.0:1788813305.014163:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813305.014280:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308060672 00000100:00100000:0.0:1788813305.014295:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308060672 00000100:00100000:0.0:1788813305.014507:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:0.0:1788813305.014519:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+29:14484:x1875706308060672:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788813305.014898:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+30:14484:x1875706308060672:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 380us (749us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788813305.014908:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00080000:3.0:1788813305.026147:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813305.026364:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813305.026886:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308060928 00000100:00100000:2.0:1788813305.026902:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308060928 00000100:00100000:2.0:1788813305.027110:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:2.0:1788813305.027125:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+30:14484:x1875706308060928:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788813305.027273:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+30:14484:x1875706308060928:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 152us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813305.027283:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:1.0:1788813305.035573:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813305.038075:0:16041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308061056 00000100:00100000:3.0:1788813305.038099:0:16041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308061056 00000100:00100000:3.0:1788813305.039976:0:16041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:3.0:1788813305.040022:0:16041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a4682b5-f19d-455b-8e64-4014cc43b65c+30:14484:x1875706308061056:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813305.040054:0:16041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813305.040087:0:16041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ed84b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2f85 expref: -99 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.040182:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1ed852 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.040199:0:16041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1ed852 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.040215:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1ed852 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813305.040280:0:16041:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813305.040306:0:16041:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1ed852 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.040479:0:16041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d000/0x1b294f297b1ed84b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f85 expref: 32 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.040501:0:16041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1ed852 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f85 expref: 31 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.040510:0:16041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93ef077b4100) 00010000:00010000:3.0:1788813305.040513:0:16041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788813305.040518:0:16041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef4214d600, rc 0) 00000100:00100000:3.0:1788813305.040628:0:16041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a4682b5-f19d-455b-8e64-4014cc43b65c+31:14484:x1875706308061056:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 626us (5068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813305.040638:0:16041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:1.0:1788813305.049944:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813305.050898:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308061184 00000100:00100000:0.0:1788813305.050916:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308061184 00000100:00100000:0.0:1788813305.051065:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:0.0:1788813305.051078:0:15044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+6:2363:x1875706308061184:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813305.051102:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813305.051130:0:15044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed859 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2f8c expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788813305.051165:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f1ff9, blocks: 0x1 00010000:00010000:0.0:1788813305.051191:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788813305.051196:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813305.051207:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed859 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f8c expref: 7 pid: 15044 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.051256:0:15044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed859 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f8c expref: 7 pid: 15044 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.051273:0:15044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619a00, rc 0) 00000100:00100000:0.0:1788813305.051490:0:15044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+7:2363:x1875706308061184:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 413us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813305.051498:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:1.0:1788813305.063615:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813305.063741:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308061440 00000100:00100000:2.0:1788813305.063754:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308061440 00000100:00100000:2.0:1788813305.063874:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:2.0:1788813305.063886:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+31:14484:x1875706308061440:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788813305.064038:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+31:14484:x1875706308061440:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 153us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813305.064046:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:1.0:1788813305.066738:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813305.066889:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308061568 00000100:00100000:0.0:1788813305.066904:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308061568 00000100:00100000:0.0:1788813305.066972:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:0.0:1788813305.066982:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+31:14484:x1875706308061568:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788813305.149296:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:1.0:1788813305.149357:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000004:00080000:1.0:1788813305.149372:0:5856:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788813305.149415:0:5856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1788813305.149577:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788813305.149602:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef368c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322719616:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788813305.149689:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813305.149775:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322719616 00000100:00100000:1.0:1788813305.149815:0:15043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322719616 00000100:00100000:1.0:1788813305.149903:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788813305.149913:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322719616:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788813305.150477:0:15043:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788813305.150483:0:15043:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788813305.150485:0:15043:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788813305.150487:0:15043:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788813305 -> 1788813305 00002000:00010000:1.0:1788813305.150491:0:15043:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788813305.150573:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1875706322719616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 661us (884us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788813305.150583:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788813305.150618:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788813305.150666:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93ef368c4380/2, rc 0, transno 8589934595 00000100:00100000:1.0:1788813305.150674:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef368c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322719616:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788813305.154196:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+14:14484:x1875706308061568:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 87194us (87450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813305.154241:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:1.0:1788813305.159645:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813305.159811:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308061696 00000100:00100000:0.0:1788813305.159824:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308061696 00000100:00100000:0.0:1788813305.159902:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:0.0:1788813305.159914:0:15044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+7:2365:x1875706308061696:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788813305.160082:0:15044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+7:2365:x1875706308061696:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 171us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813305.160090:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:1.0:1788813305.172068:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813305.172172:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308061952 00000100:00100000:2.0:1788813305.172185:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308061952 00000100:00100000:2.0:1788813305.172259:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:2.0:1788813305.172269:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+14:14484:x1875706308061952:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788813305.172363:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813305.172397:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef4214d600/0x1b294f297b1ed852 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f85 expref: 14 pid: 16041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.172420:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93ef077b4100) 00010000:00010000:2.0:1788813305.172436:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813305.172474:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ed860 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.172489:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ed860 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.172500:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ed860 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788813305.172750:0:14360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006dac6797 reply state 00000000fdeeceee transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ed860 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813305.172761:0:14360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788813305.173277:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+15:14484:x1875706308061952:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 1006us (1221us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788813305.173286:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00010000:00010000:3.0:1788813305.175814:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ed860 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813305.176051:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813305.176132:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308062080 00000100:00100000:0.0:1788813305.176147:0:15043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308062080 00000100:00100000:0.0:1788813305.176225:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1788813305.176237:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+7:14484:x1875706308062080:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813305.176261:0:15043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813305.176303:0:15043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed867 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x78c59908dfce2f93 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.176344:0:15043:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed859 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f8c expref: 8 pid: 15044 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.176355:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813305.176360:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813305.176366:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed867 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f93 expref: 8 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.176412:0:15043:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed859 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f8c expref: 8 pid: 15044 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.176429:0:15043:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed859 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f8c expref: 8 pid: 15044 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813305.176446:0:15043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15043:1875706322719744:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788813305.176569:0:15043:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e30f840 going to sleep for 11 seconds 00010000:00010000:3.0:1788813305.176968:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ed860 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.176991:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ed860 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.176998:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164e600 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813305.177003:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ed860 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.177028:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ed860 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.177048:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93ef077b4100) 00010000:00010000:3.0:1788813305.177052:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813305.177058:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ed860 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.177065:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e600/0x1b294f297b1ed860 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813305.181435:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813305.182111:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308062208 00000100:00100000:3.0:1788813305.182125:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308062208 00010000:00010000:3.0:1788813305.182188:0:14344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed859 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f8c expref: 9 pid: 15044 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813305.182239:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:3.0:1788813305.182251:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+9:2366:x1875706308062208:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813305.182271:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813305.182301:0:14344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed859 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f8c expref: 9 pid: 15044 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.182317:0:14344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed859 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f8c expref: 9 pid: 15044 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.182356:0:14344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813305.182362:0:14344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813305.182383:0:14344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed867 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f93 expref: 9 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.182395:0:14344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed867 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f93 expref: 9 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.182450:0:14344:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed867 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f93 expref: 9 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813305.182469:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14344:1875706322719872:192.168.203.13@tcp:105: 00000100:00100000:3.0:1788813305.182581:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef35603cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1788813305.183578:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6b44bf6/0x1b294f297b1ed859 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f8c expref: 9 pid: 15044 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813305.183603:0:15043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15043:1875706322719744:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788813305.183635:0:15043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed867 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f93 expref: 8 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.183670:0:15043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93ef21619200, rc 0) 00000100:00100000:0.0:1788813305.183736:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+8:14484:x1875706308062080:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 7502us (7691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813305.183745:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:2.0:1788813305.188511:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14344:1875706322719872:192.168.203.13@tcp:105: 00010000:00010000:2.0:1788813305.188579:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813305.188678:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+7:2366:x1875706308062208:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 6428us (7265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813305.188693:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:3.0:1788813305.195008:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813305.195310:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308062336 00000100:00100000:0.0:1788813305.195323:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308062336 00000100:00100000:0.0:1788813305.195399:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:0.0:1788813305.195411:0:15044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+7:2364:x1875706308062336:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788813305.195699:0:15044:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788813305.195704:0:15044:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788813304 00002000:00010000:0.0:1788813305.195707:0:15044:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788813303 00002000:00010000:0.0:1788813305.195710:0:15044:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788813305 -> 1788813304 00002000:00010000:0.0:1788813305.195712:0:15044:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788813305.195828:0:15044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+8:2364:x1875706308062336:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 414us (830us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788813305.195838:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:1.0:1788813305.202762:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813305.210438:0:16586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308062464 00000100:00100000:2.0:1788813305.210458:0:16586:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308062464 00000100:00100000:2.0:1788813305.210560:0:16586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:2.0:1788813305.210572:0:16586:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a4682b5-f19d-455b-8e64-4014cc43b65c+8:2363:x1875706308062464:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788813305.210628:0:16586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ed86e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.210654:0:16586:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed867 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f93 expref: 8 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.210665:0:16586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813305.210670:0:16586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813305.210675:0:16586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ed86e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.210718:0:16586:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed867 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f93 expref: 8 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.210734:0:16586:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed867 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f93 expref: 8 pid: 15043 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813305.210774:0:16586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ee07d1f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16586:1875706322720000:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788813305.211035:0:16586:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef370fa3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813305.218414:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813305.218591:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308062592 00000100:00100000:0.0:1788813305.218612:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308062592 00000100:00100000:1.0:1788813305.218631:0:16586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ee07d1f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16586:1875706322720000:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788813305.218664:0:16586:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ed86e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.218665:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed867 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f93 expref: 9 pid: 15043 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813305.218713:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:0.0:1788813305.218724:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ee07d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+9:2366:x1875706308062592:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813305.218747:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813305.218822:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed867 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f93 expref: 9 pid: 15043 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.218837:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed867 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f93 expref: 9 pid: 15043 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.218879:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e8560ab/0x1b294f297b1ed867 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f93 expref: 9 pid: 15043 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.218900:0:14346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813305.218905:0:14346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813305.218911:0:14346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ed86e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.218923:0:14346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ed86e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.218948:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813305.219026:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ee07d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+8:2366:x1875706308062592:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 302us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813305.219035:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00010000:00010000:1.0:1788813305.220654:0:16586:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ed86e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.220679:0:16586:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ed86e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.220745:0:16586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ed86e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.220754:0:16586:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ed86e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.220763:0:16586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ed86e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.220770:0:16586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f000 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:1.0:1788813305.220776:0:16586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ed86e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.220831:0:16586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ed86e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.220854:0:16586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ed86e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.220863:0:16586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074d3a795/0x1b294f297b1ed86e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813305.220968:0:16586:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a4682b5-f19d-455b-8e64-4014cc43b65c+7:2363:x1875706308062464:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 10394us (18217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813305.220988:0:16586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:3.0:1788813305.227884:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813305.228292:0:16041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308062848 00000100:00100000:0.0:1788813305.228306:0:16041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308062848 00000100:00100000:0.0:1788813305.228397:0:16041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:0.0:1788813305.228409:0:16041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a4682b5-f19d-455b-8e64-4014cc43b65c+14:14484:x1875706308062848:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788813305.228669:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed875 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.228708:0:16041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed875 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.228723:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed875 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.229479:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed87c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.229500:0:16041:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed844 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f7e expref: 15 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.229509:0:16041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed87c lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.230646:0:16041:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed844 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f7e expref: 15 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.230670:0:16041:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed844 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f7e expref: 15 pid: 14359 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813305.230690:0:16041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16041:1875706322720128:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788813305.230817:0:16041:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e30f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788813305.245905:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813305.247619:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308062976 00000100:00100000:2.0:1788813305.247639:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308062976 00010000:00010000:2.0:1788813305.247701:0:14344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed844 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f7e expref: 16 pid: 14359 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813305.247760:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:2.0:1788813305.247770:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+16:2365:x1875706308062976:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813305.247827:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813305.247835:0:14344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed844 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f7e expref: 16 pid: 14359 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.247851:0:14344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed844 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f7e expref: 16 pid: 14359 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.247891:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93ef077b4100) 00010000:00010000:2.0:1788813305.247897:0:14344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed87c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.247909:0:14344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed87c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.247917:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed87c lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.247969:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813305.248162:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+16:2365:x1875706308062976:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 391us (2272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813305.248172:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00010000:00010000:0.0:1788813305.248384:0:16041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed844 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f7e expref: 15 pid: 14359 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813305.248407:0:16041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16041:1875706322720128:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788813305.248435:0:16041:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed87c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.248454:0:16041:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed87c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.248461:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed87c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788813305.248729:0:16041:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1788813305.248972:0:16041:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1788813305.249034:0:16041:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1788813305.250545:0:16041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16041:1875706322720256:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788813305.253419:0:16041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813305.253637:0:16041:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef3e30f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788813305.256679:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322720256 00000100:00100000:1.0:1788813305.256923:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322720256 00000100:00100000:1.0:1788813305.256987:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813305.256998:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16041:x1875706322720256:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788813305.257406:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16041:x1875706322720256:12345-0@lo:1000:mdt00_003.0 Request processed in 408us (3993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813305.257416:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813305.261240:0:16041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16041:1875706322720256:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788813305.262591:0:16041:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1788813305.262685:0:16041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16041:1875706322720384:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788813305.263235:0:16041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813305.263266:0:16041:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef077abd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813305.263416:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322720384 00000100:00100000:1.0:1788813305.263424:0:14365:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322720384 00000100:00100000:1.0:1788813305.263466:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813305.263475:0:14365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef20e4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:16041:x1875706322720384:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788813305.263721:0:14365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef20e4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:16041:x1875706322720384:12345-0@lo:1000:mdt00_003.0 Request processed in 246us (484us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788813305.263729:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788813305.264606:0:16041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16041:1875706322720384:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788813305.264675:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed87c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.264687:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed87c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.264696:0:16041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed87c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.264703:0:16041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619a00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813305.264708:0:16041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed87c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.264742:0:16041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed87c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.264762:0:16041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93ef077b4100) 00010000:00010000:3.0:1788813305.264766:0:16041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813305.264773:0:16041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed87c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.264847:0:16041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619a00/0x1b294f297b1ed87c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.264894:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ed7d4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.264901:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ed7d4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.264908:0:16041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ed7d4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.264912:0:16041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619000 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:3.0:1788813305.264916:0:16041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ed7d4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.264923:0:16041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ed7d4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.264931:0:16041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ef077f6300) 00010000:00010000:3.0:1788813305.264933:0:16041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813305.264942:0:16041:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ed7db lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f62 expref: 18 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.264966:0:16041:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ed7db lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f62 expref: 18 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.264988:0:16041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ed7db lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f62 expref: 18 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.265073:0:16041:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93ef1164e200/0x1b294f297b1ed7db lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x78c59908dfce2f62 expref: 18 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813305.265090:0:16041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16041:1875706322720512:192.168.203.13@tcp:105: 00000100:00100000:3.0:1788813305.265205:0:16041:0:(client.c:2716:ptlrpc_set_wait()) set ffff93ef35603900 going to sleep for 11 seconds 00000100:00100000:0.0:1788813305.275226:0:16041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16041:1875706322720512:192.168.203.13@tcp:105: 00010000:00010000:0.0:1788813305.275264:0:16041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ed7d4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.275277:0:16041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619000/0x1b294f297b1ed7d4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.275314:0:16041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed883 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.275342:0:16041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed883 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.275376:0:16041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed883 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.275390:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed883 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.275397:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed883 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.275404:0:16041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed883 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.275410:0:16041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619c00 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813305.275415:0:16041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed883 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.275423:0:16041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed883 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.275437:0:16041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ef077f6300) 00010000:00010000:0.0:1788813305.275440:0:16041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813305.275445:0:16041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed883 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.275451:0:16041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619c00/0x1b294f297b1ed883 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.275461:0:16041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed875 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.275467:0:16041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed875 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.275482:0:16041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed875 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.275488:0:16041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619200 already unused, calling callback (ffffffffc1eb14f0) 00010000:00010000:0.0:1788813305.275491:0:16041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed875 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.275497:0:16041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed875 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.275505:0:16041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93ef077f6300) 00010000:00010000:0.0:1788813305.275508:0:16041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788813305.275511:0:16041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed875 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.275517:0:16041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed875 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16041 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813305.276088:0:16041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a4682b5-f19d-455b-8e64-4014cc43b65c+18:14484:x1875706308062848:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 47676us (48221us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788813305.276101:0:16041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00000020:00080000:0.0:1788813305.276110:0:16041:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788813305.276264:0:14390:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788813305.276273:0:14390:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788813305.276310:0:14390:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788813305.276317:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788813305.278148:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788813305.278297:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308063104 00000100:00100000:3.0:1788813305.278310:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308063104 00000100:00100000:3.0:1788813305.278401:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:3.0:1788813305.278412:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef1211dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+18:14482:x1875706308063104:12345-192.168.203.13@tcp:49:dd.0 00000100:00100000:3.0:1788813305.278777:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef1211dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+18:14482:x1875706308063104:12345-192.168.203.13@tcp:49:dd.0 Request processed in 366us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813305.279470:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:1.0:1788813305.284519:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813305.284631:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308063360 00000100:00100000:0.0:1788813305.284647:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308063360 00000100:00100000:0.0:1788813305.284721:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:0.0:1788813305.284733:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+18:14484:x1875706308063360:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788813305.285628:0:14362:0:(mdd_object.c:4199:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788813305.285744:0:14362:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788813305.285835:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed88a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.285857:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed88a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.285870:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed88a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.285879:0:14362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed88a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.285886:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed88a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.285893:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed88a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.285909:0:14362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788813305.286040:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+20:14484:x1875706308063360:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 1307us (1532us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788813305.286050:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000020:00080000:0.0:1788813305.286056:0:14362:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788813305.289877:0:16048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813305.289899:0:16048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed88a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.289913:0:16048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619200 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:1.0:1788813305.289919:0:16048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed88a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.289963:0:16048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed88a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.289998:0:16048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93ef077b4100) 00010000:00010000:1.0:1788813305.290001:0:16048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788813305.290007:0:16048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed88a lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.290013:0:16048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93ef21619200/0x1b294f297b1ed88a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.290036:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813305.290039:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813305.290041:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813305.499158:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813305.499271:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813305.503710:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813305.508260:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308063488 00000100:00100000:0.0:1788813305.508284:0:15048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308063488 00000100:00100000:0.0:1788813305.508410:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308063616 00000100:00100000:0.0:1788813305.508414:0:15048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308063616 00000100:00100000:0.0:1788813305.508444:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:0.0:1788813305.508455:0:15048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+8:2365:x1875706308063488:12345-192.168.203.13@tcp:4:dd.0 00002000:00010000:0.0:1788813305.508522:0:15048:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9f1ff8, atime: 0x6a9f1ff7, ctime: 0x6a9f1ff8, blocks: 0x1 00010000:00010000:0.0:1788813305.508544:0:15048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1ed891 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.508585:0:15048:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788813305.508591:0:15048:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813305.508599:0:15048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1ed891 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.508618:0:15048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1ed891 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813305.516572:0:15050:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788813305.516594:0:15050:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788813305.516970:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308063744 00000100:00100000:3.0:1788813305.516985:0:15050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308063744 00000100:00100000:0.0:1788813305.521334:0:16589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:0.0:1788813305.521355:0:16589:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6a4682b5-f19d-455b-8e64-4014cc43b65c+10:2366:x1875706308063616:12345-192.168.203.13@tcp:4:dd.0 00010000:00010000:0.0:1788813305.521397:0:16589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cae5a59/0x1b294f297b1ed898 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.521416:0:16589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813305.521421:0:16589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813305.521427:0:16589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cae5a59/0x1b294f297b1ed898 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.521440:0:16589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cae5a59/0x1b294f297b1ed898 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788813305.623524:0:15048:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1788813305.623547:0:15048:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788813304 -> 1788813305 00002000:00010000:1.0:1788813305.623550:0:15048:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1788813305.623565:0:15048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1ed891 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.623579:0:15048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1ed891 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.623588:0:15048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1ed891 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.623613:0:15048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619c00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:1.0:1788813305.623618:0:15048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1ed891 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.623627:0:15048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1ed891 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.623649:0:15048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1ed891 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.623656:0:15048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098f00f33/0x1b294f297b1ed891 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813305.623747:0:15048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+14:2365:x1875706308063488:12345-192.168.203.13@tcp:4:dd.0 Request processed in 115288us (124599us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788813305.623760:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:1.0:1788813305.623832:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:1.0:1788813305.623844:0:15048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef368c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+13:2366:x1875706308063744:12345-192.168.203.13@tcp:4:dd.0 00010000:00010000:1.0:1788813305.623876:0:15048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ed89f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.623889:0:15048:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788813305.623893:0:15048:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813305.623898:0:15048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ed89f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.623921:0:15048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ed89f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788813305.624348:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:1.0:1788813305.624366:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00010000:00010000:3.0:1788813305.634477:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788813305.675659:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:0.0:1788813305.678870:0:16589:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1788813305.678879:0:16589:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 6151 00010000:00010000:0.0:1788813305.678893:0:16589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cae5a59/0x1b294f297b1ed898 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.678926:0:16589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cae5a59/0x1b294f297b1ed898 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.678934:0:16589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cae5a59/0x1b294f297b1ed898 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.678941:0:16589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef21619800 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813305.678947:0:16589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cae5a59/0x1b294f297b1ed898 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.678955:0:16589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cae5a59/0x1b294f297b1ed898 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.678985:0:16589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cae5a59/0x1b294f297b1ed898 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813305.678994:0:16589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cae5a59/0x1b294f297b1ed898 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813305.679698:0:16589:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6a4682b5-f19d-455b-8e64-4014cc43b65c+9:2366:x1875706308063616:12345-192.168.203.13@tcp:4:dd.0 Request processed in 158344us (180421us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788813305.679709:0:16589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00010000:00010000:2.0:1788813305.714012:0:15048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ed89f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.714031:0:15048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ed89f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.714039:0:15048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ed89f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.714046:0:15048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fca00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:2.0:1788813305.714051:0:15048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ed89f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.714060:0:15048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ed89f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.714079:0:15048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ed89f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.714087:0:15048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ed89f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813305.714220:0:15048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef368c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+7:2366:x1875706308063744:12345-192.168.203.13@tcp:4:dd.0 Request processed in 90375us (210520us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788813305.714231:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00000001:00080000:0.0:1788813305.717582:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000100:00100000:1.0:1788813305.727331:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813305.727365:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813305.727396:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813305.727423:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813305.727527:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788813305.732349:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308063872 00000100:00100000:2.0:1788813305.732365:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308063872 00000100:00100000:3.0:1788813305.732404:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308064128 00000100:00100000:3.0:1788813305.732409:0:15050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308064128 00000100:00100000:2.0:1788813305.732436:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308064000 00000100:00100000:2.0:1788813305.732439:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308064000 00000100:00100000:2.0:1788813305.732454:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308064256 00000100:00100000:2.0:1788813305.732457:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308064256 00000100:00100000:2.0:1788813305.732478:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308064384 00000100:00100000:2.0:1788813305.732481:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308064384 00000100:00100000:2.0:1788813305.732504:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:2.0:1788813305.732514:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+9:2366:x1875706308063872:12345-192.168.203.13@tcp:4:dd.0 00002000:00010000:2.0:1788813305.732573:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a9f1ff9, atime: 0x6a9f1ff7, ctime: 0x0, blocks: 0x1807 00000100:00100000:1.0:1788813305.732579:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00010000:00010000:2.0:1788813305.732582:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed8a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813305.732586:0:15050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+9:2366:x1875706308064000:12345-192.168.203.13@tcp:4:dd.0 00010000:00010000:2.0:1788813305.732599:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=466s v=(0 0) 00010000:00010000:1.0:1788813305.732601:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ed8ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.732604:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813305.732610:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed8a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.732623:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed8a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.732725:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813305.732730:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813305.732734:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ed8ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813305.732743:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ed8ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788813305.798692:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:2.0:1788813305.798828:0:15049:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:2.0:1788813305.798846:0:15049:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1788813305 00002000:00010000:2.0:1788813305.798849:0:15049:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:2.0:1788813305.798863:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed8a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.798878:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed8a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.798887:0:15049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed8a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.798895:0:15049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164ec00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:2.0:1788813305.798900:0:15049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed8a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.798910:0:15049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed8a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.798929:0:15049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed8a6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.798937:0:15049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed8a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813305.799030:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+12:2366:x1875706308063872:12345-192.168.203.13@tcp:4:dd.0 Request processed in 66513us (71702us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788813305.799040:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:2.0:1788813305.799079:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:2.0:1788813305.799092:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+11:2366:x1875706308064256:12345-192.168.203.13@tcp:4:dd.0 00010000:00010000:2.0:1788813305.799120:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007e324d6/0x1b294f297b1ed8b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.799132:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813305.799137:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813305.799143:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007e324d6/0x1b294f297b1ed8b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.799154:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007e324d6/0x1b294f297b1ed8b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788813305.830461:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:3.0:1788813305.830591:0:15050:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7340032 00002000:00010000:3.0:1788813305.830601:0:15050:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:3.0:1788813305.830615:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ed8ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.830629:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ed8ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.830639:0:15050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ed8ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.830646:0:15050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef354fca00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813305.830651:0:15050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ed8ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.830660:0:15050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ed8ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.830680:0:15050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ed8ad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.830687:0:15050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085fbcc11/0x1b294f297b1ed8ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813305.830818:0:15050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+11:2366:x1875706308064000:12345-192.168.203.13@tcp:4:dd.0 Request processed in 98194us (103383us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1788813305.830828:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:3.0:1788813305.830856:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:3.0:1788813305.830875:0:15050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+10:2366:x1875706308064384:12345-192.168.203.13@tcp:4:dd.0 00010000:00010000:3.0:1788813305.830905:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaaca509/0x1b294f297b1ed8bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.830918:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813305.830922:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813305.830928:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaaca509/0x1b294f297b1ed8bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813305.830954:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aaaca509/0x1b294f297b1ed8bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788813305.888374:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:2.0:1788813305.888456:0:15049:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:2.0:1788813305.888462:0:15049:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:2.0:1788813305.888477:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007e324d6/0x1b294f297b1ed8b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.888488:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007e324d6/0x1b294f297b1ed8b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.888497:0:15049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007e324d6/0x1b294f297b1ed8b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.888504:0:15049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164f800 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:2.0:1788813305.888508:0:15049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007e324d6/0x1b294f297b1ed8b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.888546:0:15049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007e324d6/0x1b294f297b1ed8b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.888567:0:15049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007e324d6/0x1b294f297b1ed8b4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.888576:0:15049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007e324d6/0x1b294f297b1ed8b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813305.888677:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+10:2366:x1875706308064256:12345-192.168.203.13@tcp:4:dd.0 Request processed in 89584us (161247us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788813305.888687:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:2.0:1788813305.888719:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1788813305.888731:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+9:2366:x1875706308064128:12345-192.168.203.13@tcp:4:dd.0 00010000:00010000:2.0:1788813305.888762:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed8c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.888776:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813305.888812:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813305.888818:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed8c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813305.888841:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed8c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788813305.999023:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:0.0:1788813306.001737:0:15050:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:0.0:1788813306.001764:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaaca509/0x1b294f297b1ed8bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813306.001777:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aaaca509/0x1b294f297b1ed8bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813306.001820:0:15050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aaaca509/0x1b294f297b1ed8bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813306.001829:0:15050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef4214d000 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:0.0:1788813306.001834:0:15050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaaca509/0x1b294f297b1ed8bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813306.001844:0:15050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaaca509/0x1b294f297b1ed8bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813306.001867:0:15050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aaaca509/0x1b294f297b1ed8bb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813306.001876:0:15050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aaaca509/0x1b294f297b1ed8bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813306.001974:0:15050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6a4682b5-f19d-455b-8e64-4014cc43b65c+9:2366:x1875706308064384:12345-192.168.203.13@tcp:4:dd.0 Request processed in 171098us (274441us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788813306.001983:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00010000:00010000:3.0:1788813306.061925:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed8c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813306.061944:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed8c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813306.061964:0:15049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed8c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813306.061971:0:15049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93ef1164ec00 already unused, calling callback (ffffffffc14548b0) 00010000:00010000:3.0:1788813306.061976:0:15049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed8c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813306.061985:0:15049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed8c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813306.062019:0:15049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed8c2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813306.062026:0:15049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003856482d/0x1b294f297b1ed8c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813306.062125:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+7:2366:x1875706308064128:12345-192.168.203.13@tcp:4:dd.0 Request processed in 173393us (334754us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788813306.062136:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000001:00080000:3.0:1788813306.062172:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:2.0:1788813306.653208:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813307.039755:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788813307.039797:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef35a1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322720640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813307.039883:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813307.040107:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322720640 00000100:00100000:3.0:1788813307.040117:0:15047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322720640 00000100:00100000:3.0:1788813307.040191:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788813307.040201:0:15047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef35a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322720640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813307.040245:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788813307.040296:0:15047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef35a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875706322720640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813307.040304:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788813307.040353:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1788813307.040360:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93ef368c4380, transno 8589934595 00000004:00080000:3.0:1788813307.040371:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1788813307.040403:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef35a1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1875706322720640:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788813307.040602:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788813307.046301:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322720896:0@lo:400:kworker.0 00000100:00100000:0.0:1788813307.046391:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813307.046434:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813307.046440:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322721024:0@lo:400:kworker.0 00000100:00100000:0.0:1788813307.046462:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813307.046496:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322720896 00000100:00100000:0.0:1788813307.046504:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322720896 00000100:00100000:0.0:1788813307.046587:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788813307.046597:0:15044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322720896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813307.046656:0:15044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1875706322720896:12345-0@lo:400:kworker.0 Request processed in 60us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813307.046663:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788813307.046691:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322721024 00000100:00100000:0.0:1788813307.046695:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322721024 00000100:00100000:0.0:1788813307.046720:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788813307.046725:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322721024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813307.046753:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875706322721024:12345-0@lo:400:kworker.0 Request processed in 28us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813307.046759:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788813307.046817:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875706322721024:0@lo:400:kworker.0 00000100:00100000:0.0:1788813307.046827:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1875706322720896:0@lo:400:kworker.0 00000100:00100000:0.0:1788813307.046852:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef3ae78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322721152:0@lo:400:kworker.0 00000100:00100000:0.0:1788813307.046875:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813307.046891:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788813307.046896:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef20e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3301:1875706322720768:0@lo:400:kworker.0 00000100:00080000:1.0:1788813307.047107:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813307.047129:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322721152 00000100:00100000:1.0:1788813307.047133:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322721152 00000100:00100000:1.0:1788813307.047163:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788813307.047169:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322721152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813307.047203:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875706322721152:12345-0@lo:400:kworker.0 Request processed in 36us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813307.047209:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1788813307.047224:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813307.047270:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813307.047305:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93ef36ec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322721280:0@lo:400:kworker.0 00000100:00100000:0.0:1788813307.047328:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813307.047350:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef3ae78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1875706322721152:0@lo:400:kworker.0 00000100:00100000:0.0:1788813307.047367:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322721280 00000100:00100000:0.0:1788813307.047371:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322721280 00000100:00100000:0.0:1788813307.047397:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788813307.047403:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef3ae79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875706322721280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813307.047434:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef3ae79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875706322721280:12345-0@lo:400:kworker.0 Request processed in 31us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813307.047441:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788813307.047466:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef36ec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1875706322721280:0@lo:400:kworker.0 00000100:00080000:0.0:1788813307.047480:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813307.047587:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706322720768 00000100:00100000:1.0:1788813307.047592:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706322720768 00000100:00100000:1.0:1788813307.047630:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788813307.047638:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:3301:x1875706322720768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813307.047672:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b6c640d-d182-4e60-bd96-35e8ac0c3a57+19:3301:x1875706322720768:12345-0@lo:400:kworker.0 Request processed in 36us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813307.047679:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788813307.048210:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93ef20e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b6c640d-d182-4e60-bd96-35e8ac0c3a57:3301:1875706322720768:0@lo:400:kworker.0 00010000:00010000:1.0:1788813307.684332:0:16048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788813307.712529:0:16628:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:1.0:1788813308.371083:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813308.371135:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813308.371180:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813308.371211:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813308.371237:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813308.371256:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788813308.371282:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788813308.371324:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308064512 00000100:00100000:0.0:1788813308.371338:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308064512 00000100:00100000:0.0:1788813308.371405:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:0.0:1788813308.371416:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+13:2365:x1875706308064512:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813308.371507:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36fb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd9f5279-f53e-4261-be49-522548830288+13:2365:x1875706308064512:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 92us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813308.371528:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:1.0:1788813308.371656:0:16586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308064768 00000100:00100000:1.0:1788813308.371661:0:16586:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308064768 00000100:00100000:3.0:1788813308.371840:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308065024 00000100:00100000:3.0:1788813308.371845:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308065024 00000100:00100000:3.0:1788813308.371883:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308064640 00000100:00100000:3.0:1788813308.371887:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308064640 00000100:00100000:3.0:1788813308.371912:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:3.0:1788813308.371919:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eedc6376-ef6e-4238-8e03-0517eb7ab48c+6:2365:x1875706308065024:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813308.371988:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eedc6376-ef6e-4238-8e03-0517eb7ab48c+6:2365:x1875706308065024:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 68us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813308.371995:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:3.0:1788813308.372009:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:3.0:1788813308.372017:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+20:2365:x1875706308064640:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788813308.372046:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a4682b5-f19d-455b-8e64-4014cc43b65c+20:2365:x1875706308064640:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 30us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813308.372053:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:0.0:1788813308.374197:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308065280 00000100:00100000:0.0:1788813308.374806:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308065280 00000100:00100000:0.0:1788813308.374986:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308064896 00000100:00100000:0.0:1788813308.374991:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308064896 00000100:00100000:0.0:1788813308.375031:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706308065152 00000100:00100000:0.0:1788813308.375034:0:15044:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706308065152 00000100:00100000:0.0:1788813308.379127:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1788813308.379147:0:15044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+5:2365:x1875706308064768:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813308.379272:0:15044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+5:2365:x1875706308064768:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 130us (8135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813308.379279:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1788813308.379301:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:0.0:1788813308.379309:0:15044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eedc6376-ef6e-4238-8e03-0517eb7ab48c+5:2365:x1875706308065280:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813308.379340:0:15044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eedc6376-ef6e-4238-8e03-0517eb7ab48c+5:2365:x1875706308065280:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 32us (8128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813308.379346:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:0.0:1788813308.379360:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:0.0:1788813308.379574:0:15044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+5:2365:x1875706308064896:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813308.379607:0:15044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a4682b5-f19d-455b-8e64-4014cc43b65c+5:2365:x1875706308064896:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 240us (8350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813308.379613:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:0.0:1788813308.379626:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:0.0:1788813308.379632:0:15044:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93ef36b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eedc6376-ef6e-4238-8e03-0517eb7ab48c+5:2365:x1875706308065152:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788813308.379656:0:15044:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93ef36b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eedc6376-ef6e-4238-8e03-0517eb7ab48c+5:2365:x1875706308065152:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 24us (8373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813308.379662:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00080000:0.0:1788813308.379726:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788813308.379733:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788813308.379754:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788813308.709925:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29083 lines, 29083 kept, 0 dropped, 0 bad.